2022-03-15T05:36:03.492 INFO:root:teuthology version: 1.1.0-fbfc7b38 2022-03-15T05:36:03.494 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --verbose --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} --archive /home/teuthworker/archive/vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi/6736039 --name vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi -- /home/teuthworker/archive/vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi/6736039/orig.config.yaml 2022-03-15T05:36:03.550 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-03-15T05:36:03.624 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi/6736039 branch: wip-vshankar-testing1-20220314-103400 description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}} email: vshankar@redhat.com first_in_suite: false job_id: '6736039' kernel: client: branch: testing flavor: default kdb: true sha1: a020a702a220ecdaf67ca7cc4ca34d2178898edb last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-vshankar-testing1-20220314-103400 ceph: cephfs: max_mds: 3 mds_dir_prefetch: true session_timeout: 300 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: false mds op complaint time: 180 mds verify scatter: true mds_sleep_rank_change: 5000000.0 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - overall HEALTH_ - \(MON_DOWN\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 1f661216557ac5e13e140eb1700d0e5a15dd3b4c ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 1f661216557ac5e13e140eb1700d0e5a15dd3b4c kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-20220314-103400 sha1: 1f661216557ac5e13e140eb1700d0e5a15dd3b4c owner: scheduled_vshankar@teuthology priority: 200 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 sha1: 1f661216557ac5e13e140eb1700d0e5a15dd3b4c sleep_before_teardown: 0 suite: fs suite_branch: wip-vshankar-testing1-20220314-103400 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1f661216557ac5e13e140eb1700d0e5a15dd3b4c/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 1f661216557ac5e13e140eb1700d0e5a15dd3b4c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi151.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSTY7zKSx+ovNZZxQ0HmLiwN8NDO8yxw6FfEib+xY6doNJkGrsW+eFvCGVeZOIT74bWASTOiTfenCNv7m63QweHDtmqdAc349QD0YTu1k+hAsfriTyuKuWCEYkA/cbfYG9r80pYB8s5/ccKcv4LXx44hoaazHmjuaGq0vu6KpyrFLrsW/oZUwxwmBzlKHPG6KtZIo98tf35a4BcygYn6bZXlrO8sQlscijoe3+tvLIPt+Tzbk5odgkYGOXnBvFFI5GW8IqPIQ60zRhb72j9w5Y24atD87blPaGXfDd/GXyN/sMkp2K5xhKHNaGFEu9YDrZcapliv45scdoaejvdu0oMGjXcTVxO4kEonUug/J0tOPQDtq8qr3/tNdrHlT7TEeL8g0fpwngfqJxDn0OCrXD3Byqmg6rTAeqLNWxYyJdFGOxweSnYqVG84grjDAt1t0OvJ9StCD/WoLRZZLN1DsePZZ/dkC60ygLgAmIRt9nLwVgyrffa//o8MJV8sjBFl0= smithi164.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcI7+18kvVgGGVKopb2ohuxGfc7YgtMrHpDKEbqWe93O+WLlNU62KlWcZ5Ys9qGC0e+sxUJ33MkG33+rOpD7SdHDWyBJgAltt+5AIKJPVrA0RgZY6kkaO3WKzZ0N+D8xZtpQ24S5qSun068mdarxRwR1ko5vLHm+V+o0HL3fLHC6/XAzeXIklxNiiGQtXHiWsp/lZFiHX0oZdzDiA9sZvbUVKtU52bSKh86PUStVjQPXfixcQLgH4+g8mYDgo7TirYWMR8VbJFm8faCX7gHcZDoXHzitsIcDsTMDEARwll80cbBhS94y6VfSmRsOj4tyYBkLldqJH5l1GB3wTbTLlwLmkbXpm0209mwysfqcpOF9RoD3atW6/DASnRUF9d4729VFKjU93lvexdDsTQtcMt+9h8/gEPJpMCly6q160Xwa7LPLbkcMkhw1kCcizWliJJW1WtI+gI/Eoi77wisc2u36G1AT6csLtnJxx8nr8p7OvjgR4rXd5MApHf0rApZKk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - mon_thrash: check_mds_failover: true revive_delay: 20 thrash_delay: 10 - workunit: clients: all: - suites/iozone.sh teuthology_branch: master teuthology_sha1: fbfc7b381c1d662565abb9d3552d468766bf123c timestamp: 2022-03-14_08:09:40 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.22301 2022-03-15T05:36:03.624 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1f661216557ac5e13e140eb1700d0e5a15dd3b4c/qa; will attempt to use it 2022-03-15T05:36:03.625 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1f661216557ac5e13e140eb1700d0e5a15dd3b4c/qa/tasks 2022-03-15T05:36:03.626 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-03-15T05:36:03.627 INFO:teuthology.task.internal:Checking packages... 2022-03-15T05:36:03.648 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1f661216557ac5e13e140eb1700d0e5a15dd3b4c' 2022-03-15T05:36:03.649 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-03-15T05:36:03.649 INFO:teuthology.packaging:ref: None 2022-03-15T05:36:03.650 INFO:teuthology.packaging:tag: None 2022-03-15T05:36:03.650 INFO:teuthology.packaging:branch: wip-vshankar-testing1-20220314-103400 2022-03-15T05:36:03.650 INFO:teuthology.packaging:sha1: 1f661216557ac5e13e140eb1700d0e5a15dd3b4c 2022-03-15T05:36:03.651 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-vshankar-testing1-20220314-103400 2022-03-15T05:36:03.808 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-11109.g1f661216 2022-03-15T05:36:03.808 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-03-15T05:36:03.825 INFO:teuthology.task.internal:no buildpackages task found 2022-03-15T05:36:03.825 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-03-15T05:36:03.903 INFO:teuthology.task.internal:Saving configuration 2022-03-15T05:36:03.925 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-03-15T05:36:03.945 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-15T05:36:03.967 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi/6736039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-03-15 05:30:45.606651', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGUTOgJFdQAQ+M7AaUpk3t8y472szAVEER5qihJs7i0LcprJPqT5qPxBrlqw4xzgn0BOve7rF9sqKUh6EpqQ4j0='} 2022-03-15T05:36:03.990 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi/6736039', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-03-15 05:30:45.605334', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOPMf9FSGU2UUtN1IK3H92PXaDvBqmhl5tEMseaAge4z1pbowVyRz8GXEyGtf8359Lmz4Jcl/TxFqLrSTUCtHpg='} 2022-03-15T05:36:03.990 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-03-15T05:36:04.001 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-03-15T05:36:04.002 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-03-15T05:36:04.002 INFO:teuthology.run_tasks:Running task console_log... 2022-03-15T05:36:04.107 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faa2cb66e18>, signals=[15]) 2022-03-15T05:36:04.108 INFO:teuthology.run_tasks:Running task internal.connect... 2022-03-15T05:36:04.119 INFO:teuthology.task.internal:Opening connections... 2022-03-15T05:36:04.119 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2022-03-15T05:36:04.121 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-15T05:36:04.196 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2022-03-15T05:36:04.197 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-15T05:36:04.265 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-03-15T05:36:04.276 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2022-03-15T05:36:04.297 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2022-03-15T05:36:04.298 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2022-03-15T05:36:04.357 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2022-03-15T05:36:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8" 2022-03-15T05:36:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2022-03-15T05:36:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2022-03-15T05:36:04.358 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8" 2022-03-15T05:36:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2022-03-15T05:36:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-15T05:36:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2022-03-15T05:36:04.359 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-15T05:36:04.360 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2022-03-15T05:36:04.360 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-15T05:36:04.360 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-15T05:36:04.360 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-15T05:36:04.361 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2022-03-15T05:36:04.382 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2022-03-15T05:36:04.402 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2022-03-15T05:36:04.402 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2022-03-15T05:36:04.461 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2022-03-15T05:36:04.461 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="8" 2022-03-15T05:36:04.462 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2022-03-15T05:36:04.462 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2022-03-15T05:36:04.462 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="8" 2022-03-15T05:36:04.463 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el8" 2022-03-15T05:36:04.463 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-15T05:36:04.463 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2022-03-15T05:36:04.463 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-15T05:36:04.464 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2022-03-15T05:36:04.464 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-15T05:36:04.464 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-15T05:36:04.465 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-15T05:36:04.465 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2022-03-15T05:36:04.484 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-03-15T05:36:04.500 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-03-15T05:36:04.548 INFO:teuthology.task.internal:Checking for old test directory... 2022-03-15T05:36:04.549 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2022-03-15T05:36:04.552 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2022-03-15T05:36:04.571 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-03-15T05:36:04.584 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-03-15T05:36:04.585 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2022-03-15T05:36:04.611 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2022-03-15T05:36:04.641 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-03-15T05:36:04.706 INFO:teuthology.run_tasks:Running task kernel... 2022-03-15T05:36:04.726 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a020a702a220ecdaf67ca7cc4ca34d2178898edb'} 2022-03-15T05:36:04.727 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2022-03-15T05:36:04.728 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2022-03-15T05:36:04.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo lsb_release -is 2022-03-15T05:36:04.783 INFO:teuthology.orchestra.run.smithi151.stdout:CentOSStream 2022-03-15T05:36:04.785 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-03-15T05:36:04.786 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing 2022-03-15T05:36:05.010 DEBUG:teuthology.task.kernel:sha1 for client.0 is a020a702a220ecdaf67ca7cc4ca34d2178898edb 2022-03-15T05:36:05.011 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "a020a702a220ecdaf67ca7cc4ca34d2178898edb"... 2022-03-15T05:36:05.011 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2022-03-15T05:36:05.031 INFO:teuthology.orchestra.run.smithi151.stdout:4.18.0-358.el8.x86_64 2022-03-15T05:36:05.032 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-358.el8.x86_64 vs a020a702a220ecdaf67ca7cc4ca34d2178898edb 2022-03-15T05:36:05.032 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2022-03-15T05:36:05.033 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum upgrade -y linux-firmware 2022-03-15T05:36:06.092 INFO:teuthology.orchestra.run.smithi151.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-15T05:36:06.093 INFO:teuthology.orchestra.run.smithi151.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-15T05:36:08.187 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-8 - AppStream 28 MB/s | 20 MB 00:00 2022-03-15T05:36:12.203 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-8 - Base 36 MB/s | 19 MB 00:00 2022-03-15T05:36:15.119 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-8 - Extras 141 kB/s | 18 kB 00:00 2022-03-15T05:36:15.505 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-8 - PowerTools 16 MB/s | 4.2 MB 00:00 2022-03-15T05:36:18.579 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2022-03-15T05:36:19.855 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 9.8 MB/s | 11 MB 00:01 2022-03-15T05:36:22.547 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 420 kB/s | 24 kB 00:00 2022-03-15T05:36:25.035 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2022-03-15T05:36:25.036 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2022-03-15T05:36:25.036 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2022-03-15T05:36:25.037 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2022-03-15T05:36:25.037 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2022-03-15T05:36:25.037 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware noarch 20220210-106.git6342082c.el8 CentOS-Base 194 M 2022-03-15T05:36:25.037 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:36:25.038 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2022-03-15T05:36:25.038 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2022-03-15T05:36:25.038 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 1 Package 2022-03-15T05:36:25.038 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:36:25.039 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 194 M 2022-03-15T05:36:25.039 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2022-03-15T05:36:29.081 INFO:teuthology.orchestra.run.smithi151.stdout:linux-firmware-20220210-106.git6342082c.el8.noa 48 MB/s | 194 MB 00:04 2022-03-15T05:36:29.082 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2022-03-15T05:36:29.083 INFO:teuthology.orchestra.run.smithi151.stdout:Total 48 MB/s | 194 MB 00:04 2022-03-15T05:36:30.246 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2022-03-15T05:36:30.313 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2022-03-15T05:36:30.314 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2022-03-15T05:36:31.882 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2022-03-15T05:36:31.887 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2022-03-15T05:36:46.239 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2022-03-15T05:36:47.060 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : linux-firmware-20220210-106.git6342082c.el8.noarch 1/2 2022-03-15T05:36:47.300 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : linux-firmware-20211119-105.gitf5d51956.el8.noarch 2/2 2022-03-15T05:36:47.619 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: linux-firmware-20211119-105.gitf5d51956.el8.noarch 2/2 2022-03-15T05:36:47.620 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20220210-106.git6342082c.el8.noarch 1/2 2022-03-15T05:36:48.090 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20211119-105.gitf5d51956.el8.noarch 2/2 2022-03-15T05:36:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:36:48.091 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2022-03-15T05:36:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware-20220210-106.git6342082c.el8.noarch 2022-03-15T05:36:48.092 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:36:48.092 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2022-03-15T05:36:48.233 INFO:teuthology.task.kernel:Downloading kernel a020a702a220ecdaf67ca7cc4ca34d2178898edb on client.0... 2022-03-15T05:36:48.234 DEBUG:teuthology.orchestra.run.smithi151:> sudo lsb_release -is 2022-03-15T05:36:48.270 INFO:teuthology.orchestra.run.smithi151.stdout:CentOSStream 2022-03-15T05:36:48.272 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-03-15T05:36:48.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a020a702a220ecdaf67ca7cc4ca34d2178898edb 2022-03-15T05:36:48.439 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/a020a702a220ecdaf67ca7cc4ca34d2178898edb/centos/8/flavors/default/x86_64/ 2022-03-15T05:36:48.440 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-5.17.0_rc6_ceph_ga020a702a220-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/a020a702a220ecdaf67ca7cc4ca34d2178898edb/centos/8/flavors/default/x86_64/ --input-file=- 2022-03-15T05:36:48.442 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi151.front.sepia.ceph.com to complete... 2022-03-15T05:37:05.902 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15 05:37:05 URL:https://1.chacra.ceph.com/r/kernel/testing/a020a702a220ecdaf67ca7cc4ca34d2178898edb/centos/8/flavors/default/x86_64/kernel-5.17.0_rc6_ceph_ga020a702a220-1.x86_64.rpm [509935060/509935060] -> "/tmp/kernel.x86_64.rpm" [1] 2022-03-15T05:37:05.903 INFO:teuthology.orchestra.run.smithi151.stderr:FINISHED --2022-03-15 05:37:05-- 2022-03-15T05:37:05.903 INFO:teuthology.orchestra.run.smithi151.stderr:Total wall clock time: 17s 2022-03-15T05:37:05.903 INFO:teuthology.orchestra.run.smithi151.stderr:Downloaded: 1 files, 486M in 17s (28.3 MB/s) 2022-03-15T05:37:05.905 INFO:teuthology.task.kernel:Installing kernel a020a702a220ecdaf67ca7cc4ca34d2178898edb on client.0... 2022-03-15T05:37:05.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2022-03-15T05:37:07.960 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying... ######################################## 2022-03-15T05:37:08.202 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing... ######################################## 2022-03-15T05:37:08.292 INFO:teuthology.orchestra.run.smithi151.stdout:Updating / installing... 2022-03-15T05:37:46.770 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-5.17.0_rc6_ceph_ga020a702a220-1######################################## 2022-03-15T05:38:11.932 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2022-03-15T05:38:11.933 DEBUG:teuthology.orchestra.run.smithi151:> rpm -qlp /tmp/kernel.x86_64.rpm 2022-03-15T05:38:12.003 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/System.map-5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:38:12.003 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/config-5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:38:12.003 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/vmlinux-5.17.0-rc6-ceph-ga020a702a220.bz2 2022-03-15T05:38:12.004 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/vmlinuz-5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:38:12.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:38:12.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel 2022-03-15T05:38:12.004 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch 2022-03-15T05:38:12.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86 2022-03-15T05:38:12.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto 2022-03-15T05:38:12.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/blowfish-x86_64.ko 2022-03-15T05:38:12.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2022-03-15T05:38:12.005 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2022-03-15T05:38:12.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/camellia-x86_64.ko 2022-03-15T05:38:12.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2022-03-15T05:38:12.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2022-03-15T05:38:12.006 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/crc32-pclmul.ko 2022-03-15T05:38:12.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/crc32c-intel.ko 2022-03-15T05:38:12.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2022-03-15T05:38:12.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2022-03-15T05:38:12.007 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2022-03-15T05:38:12.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2022-03-15T05:38:12.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/serpent-avx2.ko 2022-03-15T05:38:12.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2022-03-15T05:38:12.008 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/sha1-ssse3.ko 2022-03-15T05:38:12.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/sha256-ssse3.ko 2022-03-15T05:38:12.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/sha512-ssse3.ko 2022-03-15T05:38:12.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2022-03-15T05:38:12.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2022-03-15T05:38:12.009 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/crypto/twofish-x86_64.ko 2022-03-15T05:38:12.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/kernel 2022-03-15T05:38:12.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/kernel/cpu 2022-03-15T05:38:12.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/kernel/cpu/mce 2022-03-15T05:38:12.010 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2022-03-15T05:38:12.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/kvm 2022-03-15T05:38:12.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/kvm/kvm-amd.ko 2022-03-15T05:38:12.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/kvm/kvm-intel.ko 2022-03-15T05:38:12.011 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/arch/x86/kvm/kvm.ko 2022-03-15T05:38:12.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto 2022-03-15T05:38:12.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/ansi_cprng.ko 2022-03-15T05:38:12.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/anubis.ko 2022-03-15T05:38:12.012 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/arc4.ko 2022-03-15T05:38:12.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/async_tx 2022-03-15T05:38:12.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/async_tx/async_memcpy.ko 2022-03-15T05:38:12.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/async_tx/async_pq.ko 2022-03-15T05:38:12.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/async_tx/async_raid6_recov.ko 2022-03-15T05:38:12.013 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/async_tx/async_tx.ko 2022-03-15T05:38:12.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/async_tx/async_xor.ko 2022-03-15T05:38:12.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/async_tx/raid6test.ko 2022-03-15T05:38:12.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/authenc.ko 2022-03-15T05:38:12.014 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/authencesn.ko 2022-03-15T05:38:12.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/blake2b_generic.ko 2022-03-15T05:38:12.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/blowfish_common.ko 2022-03-15T05:38:12.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/blowfish_generic.ko 2022-03-15T05:38:12.015 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/camellia_generic.ko 2022-03-15T05:38:12.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/cast5_generic.ko 2022-03-15T05:38:12.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/cast6_generic.ko 2022-03-15T05:38:12.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/cast_common.ko 2022-03-15T05:38:12.016 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/ccm.ko 2022-03-15T05:38:12.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/cmac.ko 2022-03-15T05:38:12.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/crc32_generic.ko 2022-03-15T05:38:12.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/crypto_engine.ko 2022-03-15T05:38:12.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/crypto_user.ko 2022-03-15T05:38:12.017 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/cts.ko 2022-03-15T05:38:12.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/des_generic.ko 2022-03-15T05:38:12.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/dh_generic.ko 2022-03-15T05:38:12.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/echainiv.ko 2022-03-15T05:38:12.018 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/essiv.ko 2022-03-15T05:38:12.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/fcrypt.ko 2022-03-15T05:38:12.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/khazad.ko 2022-03-15T05:38:12.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/lz4.ko 2022-03-15T05:38:12.019 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/lz4hc.ko 2022-03-15T05:38:12.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/md4.ko 2022-03-15T05:38:12.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/michael_mic.ko 2022-03-15T05:38:12.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/pcbc.ko 2022-03-15T05:38:12.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/pcrypt.ko 2022-03-15T05:38:12.020 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/rmd160.ko 2022-03-15T05:38:12.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/seed.ko 2022-03-15T05:38:12.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/serpent_generic.ko 2022-03-15T05:38:12.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/tcrypt.ko 2022-03-15T05:38:12.021 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/tea.ko 2022-03-15T05:38:12.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/twofish_common.ko 2022-03-15T05:38:12.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/twofish_generic.ko 2022-03-15T05:38:12.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/vmac.ko 2022-03-15T05:38:12.022 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/wp512.ko 2022-03-15T05:38:12.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/xcbc.ko 2022-03-15T05:38:12.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/xor.ko 2022-03-15T05:38:12.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/crypto/xxhash_generic.ko 2022-03-15T05:38:12.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers 2022-03-15T05:38:12.023 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/acpi 2022-03-15T05:38:12.024 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/acpi/acpi_ipmi.ko 2022-03-15T05:38:12.024 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/acpi/acpi_pad.ko 2022-03-15T05:38:12.024 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/acpi/custom_method.ko 2022-03-15T05:38:12.024 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/acpi/ec_sys.ko 2022-03-15T05:38:12.025 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/acpi/platform_profile.ko 2022-03-15T05:38:12.025 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/acpi/sbs.ko 2022-03-15T05:38:12.025 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/acpi/sbshc.ko 2022-03-15T05:38:12.025 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/acpi/video.ko 2022-03-15T05:38:12.025 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata 2022-03-15T05:38:12.026 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/acard-ahci.ko 2022-03-15T05:38:12.026 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/ahci_platform.ko 2022-03-15T05:38:12.026 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/ata_generic.ko 2022-03-15T05:38:12.026 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/libahci_platform.ko 2022-03-15T05:38:12.027 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_acpi.ko 2022-03-15T05:38:12.027 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_ali.ko 2022-03-15T05:38:12.027 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_amd.ko 2022-03-15T05:38:12.027 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_artop.ko 2022-03-15T05:38:12.027 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_atiixp.ko 2022-03-15T05:38:12.028 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_atp867x.ko 2022-03-15T05:38:12.028 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_cmd640.ko 2022-03-15T05:38:12.028 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_cmd64x.ko 2022-03-15T05:38:12.028 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_cypress.ko 2022-03-15T05:38:12.029 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_efar.ko 2022-03-15T05:38:12.029 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_hpt366.ko 2022-03-15T05:38:12.029 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_hpt37x.ko 2022-03-15T05:38:12.029 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_hpt3x2n.ko 2022-03-15T05:38:12.030 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_hpt3x3.ko 2022-03-15T05:38:12.030 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_it8213.ko 2022-03-15T05:38:12.030 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_it821x.ko 2022-03-15T05:38:12.030 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_jmicron.ko 2022-03-15T05:38:12.030 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_marvell.ko 2022-03-15T05:38:12.031 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_mpiix.ko 2022-03-15T05:38:12.031 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_netcell.ko 2022-03-15T05:38:12.031 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_ninja32.ko 2022-03-15T05:38:12.031 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_ns87410.ko 2022-03-15T05:38:12.032 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_ns87415.ko 2022-03-15T05:38:12.032 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_oldpiix.ko 2022-03-15T05:38:12.032 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_opti.ko 2022-03-15T05:38:12.032 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_optidma.ko 2022-03-15T05:38:12.032 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_pcmcia.ko 2022-03-15T05:38:12.033 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_pdc2027x.ko 2022-03-15T05:38:12.033 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_pdc202xx_old.ko 2022-03-15T05:38:12.033 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_piccolo.ko 2022-03-15T05:38:12.033 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_rdc.ko 2022-03-15T05:38:12.034 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_sch.ko 2022-03-15T05:38:12.034 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_serverworks.ko 2022-03-15T05:38:12.034 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_sil680.ko 2022-03-15T05:38:12.034 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_sis.ko 2022-03-15T05:38:12.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_sl82c105.ko 2022-03-15T05:38:12.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_triflex.ko 2022-03-15T05:38:12.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pata_via.ko 2022-03-15T05:38:12.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/pdc_adma.ko 2022-03-15T05:38:12.035 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_inic162x.ko 2022-03-15T05:38:12.036 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_mv.ko 2022-03-15T05:38:12.036 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_nv.ko 2022-03-15T05:38:12.036 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_promise.ko 2022-03-15T05:38:12.036 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_qstor.ko 2022-03-15T05:38:12.037 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_sil.ko 2022-03-15T05:38:12.037 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_sil24.ko 2022-03-15T05:38:12.037 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_sis.ko 2022-03-15T05:38:12.037 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_svw.ko 2022-03-15T05:38:12.037 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_sx4.ko 2022-03-15T05:38:12.038 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_uli.ko 2022-03-15T05:38:12.038 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_via.ko 2022-03-15T05:38:12.038 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ata/sata_vsc.ko 2022-03-15T05:38:12.038 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/auxdisplay 2022-03-15T05:38:12.038 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/auxdisplay/ks0108.ko 2022-03-15T05:38:12.039 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/base 2022-03-15T05:38:12.039 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/base/regmap 2022-03-15T05:38:12.039 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/base/regmap/regmap-i2c.ko 2022-03-15T05:38:12.039 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/bcma 2022-03-15T05:38:12.040 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/bcma/bcma.ko 2022-03-15T05:38:12.040 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block 2022-03-15T05:38:12.040 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/aoe 2022-03-15T05:38:12.040 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/aoe/aoe.ko 2022-03-15T05:38:12.040 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/brd.ko 2022-03-15T05:38:12.041 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/drbd 2022-03-15T05:38:12.041 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/drbd/drbd.ko 2022-03-15T05:38:12.041 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/floppy.ko 2022-03-15T05:38:12.041 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/loop.ko 2022-03-15T05:38:12.042 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/mtip32xx 2022-03-15T05:38:12.042 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/mtip32xx/mtip32xx.ko 2022-03-15T05:38:12.042 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/nbd.ko 2022-03-15T05:38:12.043 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/null_blk 2022-03-15T05:38:12.043 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/null_blk/null_blk.ko 2022-03-15T05:38:12.043 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/pktcdvd.ko 2022-03-15T05:38:12.043 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/rbd.ko 2022-03-15T05:38:12.044 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/sx8.ko 2022-03-15T05:38:12.044 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/virtio_blk.ko 2022-03-15T05:38:12.044 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/xen-blkback 2022-03-15T05:38:12.044 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/xen-blkback/xen-blkback.ko 2022-03-15T05:38:12.045 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/xen-blkfront.ko 2022-03-15T05:38:12.045 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/zram 2022-03-15T05:38:12.045 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/block/zram/zram.ko 2022-03-15T05:38:12.045 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char 2022-03-15T05:38:12.046 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/hangcheck-timer.ko 2022-03-15T05:38:12.046 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/hw_random 2022-03-15T05:38:12.046 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/hw_random/amd-rng.ko 2022-03-15T05:38:12.046 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/hw_random/intel-rng.ko 2022-03-15T05:38:12.046 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/hw_random/timeriomem-rng.ko 2022-03-15T05:38:12.047 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/hw_random/via-rng.ko 2022-03-15T05:38:12.047 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/hw_random/virtio-rng.ko 2022-03-15T05:38:12.047 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/ipmi 2022-03-15T05:38:12.047 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/ipmi/ipmi_devintf.ko 2022-03-15T05:38:12.048 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2022-03-15T05:38:12.048 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2022-03-15T05:38:12.048 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/ipmi/ipmi_si.ko 2022-03-15T05:38:12.048 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/ipmi/ipmi_ssif.ko 2022-03-15T05:38:12.049 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2022-03-15T05:38:12.049 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/lp.ko 2022-03-15T05:38:12.049 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/mwave 2022-03-15T05:38:12.049 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/mwave/mwave.ko 2022-03-15T05:38:12.049 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/pcmcia 2022-03-15T05:38:12.050 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/pcmcia/cm4000_cs.ko 2022-03-15T05:38:12.050 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/pcmcia/cm4040_cs.ko 2022-03-15T05:38:12.050 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/ppdev.ko 2022-03-15T05:38:12.050 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/tlclk.ko 2022-03-15T05:38:12.051 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/tpm 2022-03-15T05:38:12.051 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/tpm/tpm.ko 2022-03-15T05:38:12.051 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/tpm/tpm_atmel.ko 2022-03-15T05:38:12.051 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/tpm/tpm_infineon.ko 2022-03-15T05:38:12.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/tpm/tpm_nsc.ko 2022-03-15T05:38:12.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/tpm/tpm_tis.ko 2022-03-15T05:38:12.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/tpm/tpm_tis_core.ko 2022-03-15T05:38:12.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/uv_mmtimer.ko 2022-03-15T05:38:12.052 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/char/virtio_console.ko 2022-03-15T05:38:12.053 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/cpufreq 2022-03-15T05:38:12.053 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/cpufreq/acpi-cpufreq.ko 2022-03-15T05:38:12.053 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2022-03-15T05:38:12.053 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/cpufreq/p4-clockmod.ko 2022-03-15T05:38:12.054 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/cpufreq/pcc-cpufreq.ko 2022-03-15T05:38:12.054 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/cpufreq/powernow-k8.ko 2022-03-15T05:38:12.054 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/cpufreq/speedstep-lib.ko 2022-03-15T05:38:12.054 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto 2022-03-15T05:38:12.054 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/ccp 2022-03-15T05:38:12.055 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/ccp/ccp-crypto.ko 2022-03-15T05:38:12.055 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/ccp/ccp.ko 2022-03-15T05:38:12.055 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/padlock-aes.ko 2022-03-15T05:38:12.055 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/padlock-sha.ko 2022-03-15T05:38:12.056 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/qat 2022-03-15T05:38:12.056 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/qat/qat_common 2022-03-15T05:38:12.056 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2022-03-15T05:38:12.056 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/qat/qat_dh895xcc 2022-03-15T05:38:12.056 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2022-03-15T05:38:12.057 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/virtio 2022-03-15T05:38:12.057 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/crypto/virtio/virtio_crypto.ko 2022-03-15T05:38:12.057 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/dca 2022-03-15T05:38:12.057 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/dca/dca.ko 2022-03-15T05:38:12.058 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/devfreq 2022-03-15T05:38:12.058 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/devfreq/governor_simpleondemand.ko 2022-03-15T05:38:12.058 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/dma 2022-03-15T05:38:12.058 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/dma/dw 2022-03-15T05:38:12.058 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/dma/dw/dw_dmac.ko 2022-03-15T05:38:12.059 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/dma/ioat 2022-03-15T05:38:12.059 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/dma/ioat/ioatdma.ko 2022-03-15T05:38:12.059 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac 2022-03-15T05:38:12.059 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/amd64_edac.ko 2022-03-15T05:38:12.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/e752x_edac.ko 2022-03-15T05:38:12.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/edac_mce_amd.ko 2022-03-15T05:38:12.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/i3000_edac.ko 2022-03-15T05:38:12.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/i3200_edac.ko 2022-03-15T05:38:12.060 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/i5000_edac.ko 2022-03-15T05:38:12.061 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/i5100_edac.ko 2022-03-15T05:38:12.061 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/i5400_edac.ko 2022-03-15T05:38:12.061 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/i7300_edac.ko 2022-03-15T05:38:12.061 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/i7core_edac.ko 2022-03-15T05:38:12.062 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/i82975x_edac.ko 2022-03-15T05:38:12.062 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/ie31200_edac.ko 2022-03-15T05:38:12.062 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/sb_edac.ko 2022-03-15T05:38:12.062 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/edac/x38_edac.ko 2022-03-15T05:38:12.062 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/firmware 2022-03-15T05:38:12.063 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/firmware/edd.ko 2022-03-15T05:38:12.063 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/firmware/iscsi_ibft.ko 2022-03-15T05:38:12.063 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/gpio 2022-03-15T05:38:12.063 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/gpio/gpio-ich.ko 2022-03-15T05:38:12.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/gpio/gpio-viperboard.ko 2022-03-15T05:38:12.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid 2022-03-15T05:38:12.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-appleir.ko 2022-03-15T05:38:12.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-aureal.ko 2022-03-15T05:38:12.064 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-axff.ko 2022-03-15T05:38:12.065 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-dr.ko 2022-03-15T05:38:12.065 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-elecom.ko 2022-03-15T05:38:12.065 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-elo.ko 2022-03-15T05:38:12.065 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-emsff.ko 2022-03-15T05:38:12.065 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-gaff.ko 2022-03-15T05:38:12.066 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-gt683r.ko 2022-03-15T05:38:12.066 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-gyration.ko 2022-03-15T05:38:12.066 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-holtek-kbd.ko 2022-03-15T05:38:12.066 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-holtek-mouse.ko 2022-03-15T05:38:12.067 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-holtekff.ko 2022-03-15T05:38:12.067 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-hyperv.ko 2022-03-15T05:38:12.067 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-icade.ko 2022-03-15T05:38:12.067 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-keytouch.ko 2022-03-15T05:38:12.068 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-kye.ko 2022-03-15T05:38:12.068 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-lcpower.ko 2022-03-15T05:38:12.068 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-led.ko 2022-03-15T05:38:12.068 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-lenovo.ko 2022-03-15T05:38:12.068 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-logitech-dj.ko 2022-03-15T05:38:12.069 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-logitech-hidpp.ko 2022-03-15T05:38:12.069 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-multitouch.ko 2022-03-15T05:38:12.069 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-ortek.ko 2022-03-15T05:38:12.069 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-penmount.ko 2022-03-15T05:38:12.070 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-petalynx.ko 2022-03-15T05:38:12.070 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-picolcd.ko 2022-03-15T05:38:12.070 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-pl.ko 2022-03-15T05:38:12.070 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-plantronics.ko 2022-03-15T05:38:12.070 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-primax.ko 2022-03-15T05:38:12.071 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-rmi.ko 2022-03-15T05:38:12.071 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-arvo.ko 2022-03-15T05:38:12.071 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-common.ko 2022-03-15T05:38:12.071 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-isku.ko 2022-03-15T05:38:12.072 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-kone.ko 2022-03-15T05:38:12.072 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-koneplus.ko 2022-03-15T05:38:12.072 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-konepure.ko 2022-03-15T05:38:12.072 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-kovaplus.ko 2022-03-15T05:38:12.072 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-lua.ko 2022-03-15T05:38:12.073 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-pyra.ko 2022-03-15T05:38:12.073 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-ryos.ko 2022-03-15T05:38:12.073 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat-savu.ko 2022-03-15T05:38:12.073 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-roccat.ko 2022-03-15T05:38:12.074 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-saitek.ko 2022-03-15T05:38:12.074 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-samsung.ko 2022-03-15T05:38:12.074 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-sensor-hub.ko 2022-03-15T05:38:12.074 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-sjoy.ko 2022-03-15T05:38:12.075 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-sony.ko 2022-03-15T05:38:12.075 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-speedlink.ko 2022-03-15T05:38:12.075 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-steelseries.ko 2022-03-15T05:38:12.075 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-sunplus.ko 2022-03-15T05:38:12.075 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-thrustmaster.ko 2022-03-15T05:38:12.076 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-tivo.ko 2022-03-15T05:38:12.076 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-tmff.ko 2022-03-15T05:38:12.076 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-topseed.ko 2022-03-15T05:38:12.076 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-twinhan.ko 2022-03-15T05:38:12.076 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-uclogic.ko 2022-03-15T05:38:12.077 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-waltop.ko 2022-03-15T05:38:12.077 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-wiimote.ko 2022-03-15T05:38:12.077 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-xinmo.ko 2022-03-15T05:38:12.077 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-zpff.ko 2022-03-15T05:38:12.078 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/hid-zydacron.ko 2022-03-15T05:38:12.078 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/uhid.ko 2022-03-15T05:38:12.078 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hid/wacom.ko 2022-03-15T05:38:12.079 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hv 2022-03-15T05:38:12.079 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hv/hv_balloon.ko 2022-03-15T05:38:12.079 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hv/hv_utils.ko 2022-03-15T05:38:12.079 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hv/hv_vmbus.ko 2022-03-15T05:38:12.079 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon 2022-03-15T05:38:12.080 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/abituguru.ko 2022-03-15T05:38:12.080 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/abituguru3.ko 2022-03-15T05:38:12.080 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/acpi_power_meter.ko 2022-03-15T05:38:12.080 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ad7414.ko 2022-03-15T05:38:12.080 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ad7418.ko 2022-03-15T05:38:12.081 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adc128d818.ko 2022-03-15T05:38:12.081 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adm1021.ko 2022-03-15T05:38:12.081 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adm1025.ko 2022-03-15T05:38:12.081 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adm1026.ko 2022-03-15T05:38:12.082 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adm1029.ko 2022-03-15T05:38:12.082 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adm1031.ko 2022-03-15T05:38:12.082 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adm9240.ko 2022-03-15T05:38:12.082 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ads7828.ko 2022-03-15T05:38:12.082 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adt7410.ko 2022-03-15T05:38:12.083 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adt7411.ko 2022-03-15T05:38:12.083 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adt7462.ko 2022-03-15T05:38:12.083 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adt7470.ko 2022-03-15T05:38:12.083 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adt7475.ko 2022-03-15T05:38:12.084 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/adt7x10.ko 2022-03-15T05:38:12.084 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/amc6821.ko 2022-03-15T05:38:12.084 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/applesmc.ko 2022-03-15T05:38:12.084 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/asb100.ko 2022-03-15T05:38:12.084 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/asc7621.ko 2022-03-15T05:38:12.085 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/asus_atk0110.ko 2022-03-15T05:38:12.085 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/atxp1.ko 2022-03-15T05:38:12.085 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/coretemp.ko 2022-03-15T05:38:12.085 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/dell-smm-hwmon.ko 2022-03-15T05:38:12.086 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/dme1737.ko 2022-03-15T05:38:12.086 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ds1621.ko 2022-03-15T05:38:12.086 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ds620.ko 2022-03-15T05:38:12.086 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/emc1403.ko 2022-03-15T05:38:12.086 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/emc6w201.ko 2022-03-15T05:38:12.087 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/f71805f.ko 2022-03-15T05:38:12.087 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/f71882fg.ko 2022-03-15T05:38:12.087 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/f75375s.ko 2022-03-15T05:38:12.087 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/fam15h_power.ko 2022-03-15T05:38:12.088 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/fschmd.ko 2022-03-15T05:38:12.088 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/g760a.ko 2022-03-15T05:38:12.088 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/g762.ko 2022-03-15T05:38:12.088 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/gl518sm.ko 2022-03-15T05:38:12.088 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/gl520sm.ko 2022-03-15T05:38:12.089 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/hwmon-vid.ko 2022-03-15T05:38:12.089 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/i5500_temp.ko 2022-03-15T05:38:12.089 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/i5k_amb.ko 2022-03-15T05:38:12.089 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ibmaem.ko 2022-03-15T05:38:12.090 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ibmpex.ko 2022-03-15T05:38:12.090 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ina209.ko 2022-03-15T05:38:12.090 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ina2xx.ko 2022-03-15T05:38:12.090 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/it87.ko 2022-03-15T05:38:12.091 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/k10temp.ko 2022-03-15T05:38:12.091 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/k8temp.ko 2022-03-15T05:38:12.091 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lineage-pem.ko 2022-03-15T05:38:12.091 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm63.ko 2022-03-15T05:38:12.091 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm73.ko 2022-03-15T05:38:12.092 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm75.ko 2022-03-15T05:38:12.092 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm77.ko 2022-03-15T05:38:12.092 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm78.ko 2022-03-15T05:38:12.092 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm80.ko 2022-03-15T05:38:12.093 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm83.ko 2022-03-15T05:38:12.093 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm85.ko 2022-03-15T05:38:12.093 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm87.ko 2022-03-15T05:38:12.093 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm90.ko 2022-03-15T05:38:12.094 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm92.ko 2022-03-15T05:38:12.094 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm93.ko 2022-03-15T05:38:12.094 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm95234.ko 2022-03-15T05:38:12.094 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm95241.ko 2022-03-15T05:38:12.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/lm95245.ko 2022-03-15T05:38:12.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ltc2945.ko 2022-03-15T05:38:12.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ltc4151.ko 2022-03-15T05:38:12.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ltc4215.ko 2022-03-15T05:38:12.095 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ltc4222.ko 2022-03-15T05:38:12.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ltc4245.ko 2022-03-15T05:38:12.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ltc4260.ko 2022-03-15T05:38:12.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/ltc4261.ko 2022-03-15T05:38:12.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/max16065.ko 2022-03-15T05:38:12.096 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/max1619.ko 2022-03-15T05:38:12.097 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/max1668.ko 2022-03-15T05:38:12.097 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/max197.ko 2022-03-15T05:38:12.097 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/max6639.ko 2022-03-15T05:38:12.097 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/max6642.ko 2022-03-15T05:38:12.098 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/max6650.ko 2022-03-15T05:38:12.098 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/max6697.ko 2022-03-15T05:38:12.098 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/mcp3021.ko 2022-03-15T05:38:12.098 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/nct6683.ko 2022-03-15T05:38:12.098 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/nct6775.ko 2022-03-15T05:38:12.099 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/nct7802.ko 2022-03-15T05:38:12.099 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pc87360.ko 2022-03-15T05:38:12.099 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pc87427.ko 2022-03-15T05:38:12.099 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pcf8591.ko 2022-03-15T05:38:12.100 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus 2022-03-15T05:38:12.100 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/adm1275.ko 2022-03-15T05:38:12.100 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/lm25066.ko 2022-03-15T05:38:12.100 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/ltc2978.ko 2022-03-15T05:38:12.100 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/max16064.ko 2022-03-15T05:38:12.101 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/max34440.ko 2022-03-15T05:38:12.101 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/max8688.ko 2022-03-15T05:38:12.101 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/pmbus.ko 2022-03-15T05:38:12.101 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2022-03-15T05:38:12.101 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/tps40422.ko 2022-03-15T05:38:12.102 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/ucd9000.ko 2022-03-15T05:38:12.102 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/ucd9200.ko 2022-03-15T05:38:12.102 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/pmbus/zl6100.ko 2022-03-15T05:38:12.102 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/powr1220.ko 2022-03-15T05:38:12.103 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/sch5627.ko 2022-03-15T05:38:12.103 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/sch5636.ko 2022-03-15T05:38:12.103 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/sch56xx-common.ko 2022-03-15T05:38:12.103 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/sht15.ko 2022-03-15T05:38:12.104 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/sht21.ko 2022-03-15T05:38:12.104 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/shtc1.ko 2022-03-15T05:38:12.104 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/sis5595.ko 2022-03-15T05:38:12.104 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/smsc47b397.ko 2022-03-15T05:38:12.104 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/smsc47m1.ko 2022-03-15T05:38:12.105 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/smsc47m192.ko 2022-03-15T05:38:12.105 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/thmc50.ko 2022-03-15T05:38:12.105 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/tmp102.ko 2022-03-15T05:38:12.105 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/tmp103.ko 2022-03-15T05:38:12.106 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/tmp401.ko 2022-03-15T05:38:12.106 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/tmp421.ko 2022-03-15T05:38:12.106 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/via-cputemp.ko 2022-03-15T05:38:12.106 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/via686a.ko 2022-03-15T05:38:12.106 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/vt1211.ko 2022-03-15T05:38:12.107 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/vt8231.ko 2022-03-15T05:38:12.108 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/w83627ehf.ko 2022-03-15T05:38:12.108 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/w83627hf.ko 2022-03-15T05:38:12.108 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/w83781d.ko 2022-03-15T05:38:12.108 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/w83791d.ko 2022-03-15T05:38:12.109 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/w83792d.ko 2022-03-15T05:38:12.109 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/w83793.ko 2022-03-15T05:38:12.109 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/w83795.ko 2022-03-15T05:38:12.110 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/w83l785ts.ko 2022-03-15T05:38:12.110 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/hwmon/w83l786ng.ko 2022-03-15T05:38:12.110 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c 2022-03-15T05:38:12.110 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/algos 2022-03-15T05:38:12.110 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2022-03-15T05:38:12.111 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2022-03-15T05:38:12.111 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses 2022-03-15T05:38:12.111 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2022-03-15T05:38:12.111 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-amd756.ko 2022-03-15T05:38:12.112 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-amd8111.ko 2022-03-15T05:38:12.112 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-designware-core.ko 2022-03-15T05:38:12.112 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2022-03-15T05:38:12.112 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2022-03-15T05:38:12.112 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2022-03-15T05:38:12.113 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-i801.ko 2022-03-15T05:38:12.113 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-isch.ko 2022-03-15T05:38:12.113 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-ismt.ko 2022-03-15T05:38:12.113 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2022-03-15T05:38:12.114 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-nforce2.ko 2022-03-15T05:38:12.114 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-parport.ko 2022-03-15T05:38:12.114 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2022-03-15T05:38:12.114 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-piix4.ko 2022-03-15T05:38:12.114 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-scmi.ko 2022-03-15T05:38:12.115 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-simtec.ko 2022-03-15T05:38:12.115 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-sis96x.ko 2022-03-15T05:38:12.115 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2022-03-15T05:38:12.115 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-via.ko 2022-03-15T05:38:12.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-viapro.ko 2022-03-15T05:38:12.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/busses/i2c-viperboard.ko 2022-03-15T05:38:12.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/i2c-dev.ko 2022-03-15T05:38:12.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/i2c-mux.ko 2022-03-15T05:38:12.116 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/i2c-slave-eeprom.ko 2022-03-15T05:38:12.117 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/i2c-smbus.ko 2022-03-15T05:38:12.117 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/i2c/i2c-stub.ko 2022-03-15T05:38:12.117 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband 2022-03-15T05:38:12.117 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/core 2022-03-15T05:38:12.118 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/core/ib_cm.ko 2022-03-15T05:38:12.118 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/core/ib_core.ko 2022-03-15T05:38:12.118 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/core/ib_umad.ko 2022-03-15T05:38:12.118 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/core/ib_uverbs.ko 2022-03-15T05:38:12.118 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/core/iw_cm.ko 2022-03-15T05:38:12.119 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/core/rdma_cm.ko 2022-03-15T05:38:12.119 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/core/rdma_ucm.ko 2022-03-15T05:38:12.119 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/hw 2022-03-15T05:38:12.119 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/hw/cxgb4 2022-03-15T05:38:12.120 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2022-03-15T05:38:12.120 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/hw/mlx4 2022-03-15T05:38:12.120 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2022-03-15T05:38:12.120 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/hw/mlx5 2022-03-15T05:38:12.120 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2022-03-15T05:38:12.121 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/hw/mthca 2022-03-15T05:38:12.121 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2022-03-15T05:38:12.121 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp 2022-03-15T05:38:12.121 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp/ipoib 2022-03-15T05:38:12.122 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2022-03-15T05:38:12.122 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp/iser 2022-03-15T05:38:12.122 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2022-03-15T05:38:12.122 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp/isert 2022-03-15T05:38:12.122 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2022-03-15T05:38:12.123 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp/srp 2022-03-15T05:38:12.123 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2022-03-15T05:38:12.123 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp/srpt 2022-03-15T05:38:12.123 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2022-03-15T05:38:12.123 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input 2022-03-15T05:38:12.124 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/gameport 2022-03-15T05:38:12.124 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/gameport/emu10k1-gp.ko 2022-03-15T05:38:12.124 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/gameport/fm801-gp.ko 2022-03-15T05:38:12.124 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/gameport/gameport.ko 2022-03-15T05:38:12.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/gameport/lightning.ko 2022-03-15T05:38:12.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/gameport/ns558.ko 2022-03-15T05:38:12.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/joydev.ko 2022-03-15T05:38:12.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/keyboard 2022-03-15T05:38:12.125 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/keyboard/gpio_keys.ko 2022-03-15T05:38:12.126 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/mouse 2022-03-15T05:38:12.126 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/mouse/appletouch.ko 2022-03-15T05:38:12.126 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/mouse/bcm5974.ko 2022-03-15T05:38:12.126 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/mouse/cyapatp.ko 2022-03-15T05:38:12.127 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/mouse/elan_i2c.ko 2022-03-15T05:38:12.127 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/mouse/sermouse.ko 2022-03-15T05:38:12.127 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/mouse/synaptics_i2c.ko 2022-03-15T05:38:12.127 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/mouse/synaptics_usb.ko 2022-03-15T05:38:12.128 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/mouse/vsxxxaa.ko 2022-03-15T05:38:12.128 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/rmi4 2022-03-15T05:38:12.128 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/rmi4/rmi_core.ko 2022-03-15T05:38:12.128 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/serio 2022-03-15T05:38:12.128 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/serio/altera_ps2.ko 2022-03-15T05:38:12.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/serio/arc_ps2.ko 2022-03-15T05:38:12.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/serio/hyperv-keyboard.ko 2022-03-15T05:38:12.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/serio/serio_raw.ko 2022-03-15T05:38:12.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/input/sparse-keymap.ko 2022-03-15T05:38:12.129 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/iommu 2022-03-15T05:38:12.130 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/iommu/amd 2022-03-15T05:38:12.130 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/iommu/amd/iommu_v2.ko 2022-03-15T05:38:12.130 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds 2022-03-15T05:38:12.130 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/leds-blinkm.ko 2022-03-15T05:38:12.131 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/leds-clevo-mail.ko 2022-03-15T05:38:12.131 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/leds-lm3530.ko 2022-03-15T05:38:12.131 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/leds-lp3944.ko 2022-03-15T05:38:12.131 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/leds-ss4200.ko 2022-03-15T05:38:12.131 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/trigger 2022-03-15T05:38:12.132 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/trigger/ledtrig-audio.ko 2022-03-15T05:38:12.132 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2022-03-15T05:38:12.132 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/trigger/ledtrig-camera.ko 2022-03-15T05:38:12.132 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2022-03-15T05:38:12.133 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2022-03-15T05:38:12.133 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2022-03-15T05:38:12.133 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2022-03-15T05:38:12.133 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/trigger/ledtrig-timer.ko 2022-03-15T05:38:12.133 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/leds/trigger/ledtrig-transient.ko 2022-03-15T05:38:12.134 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md 2022-03-15T05:38:12.134 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/bcache 2022-03-15T05:38:12.134 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/bcache/bcache.ko 2022-03-15T05:38:12.134 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-bio-prison.ko 2022-03-15T05:38:12.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-cache-smq.ko 2022-03-15T05:38:12.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-cache.ko 2022-03-15T05:38:12.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-crypt.ko 2022-03-15T05:38:12.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-delay.ko 2022-03-15T05:38:12.135 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-flakey.ko 2022-03-15T05:38:12.136 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-log-userspace.ko 2022-03-15T05:38:12.136 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-multipath.ko 2022-03-15T05:38:12.136 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-queue-length.ko 2022-03-15T05:38:12.136 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-raid.ko 2022-03-15T05:38:12.136 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-round-robin.ko 2022-03-15T05:38:12.137 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-service-time.ko 2022-03-15T05:38:12.137 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-switch.ko 2022-03-15T05:38:12.137 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-thin-pool.ko 2022-03-15T05:38:12.137 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/dm-verity.ko 2022-03-15T05:38:12.138 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/faulty.ko 2022-03-15T05:38:12.138 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/linear.ko 2022-03-15T05:38:12.138 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/multipath.ko 2022-03-15T05:38:12.138 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/persistent-data 2022-03-15T05:38:12.138 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2022-03-15T05:38:12.139 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/raid0.ko 2022-03-15T05:38:12.139 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/raid1.ko 2022-03-15T05:38:12.139 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/raid10.ko 2022-03-15T05:38:12.139 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/md/raid456.ko 2022-03-15T05:38:12.140 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/message 2022-03-15T05:38:12.140 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/message/fusion 2022-03-15T05:38:12.140 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/message/fusion/mptbase.ko 2022-03-15T05:38:12.140 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/message/fusion/mptctl.ko 2022-03-15T05:38:12.140 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/message/fusion/mptfc.ko 2022-03-15T05:38:12.141 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/message/fusion/mptlan.ko 2022-03-15T05:38:12.141 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/message/fusion/mptsas.ko 2022-03-15T05:38:12.141 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/message/fusion/mptscsih.ko 2022-03-15T05:38:12.141 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/message/fusion/mptspi.ko 2022-03-15T05:38:12.141 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/mfd 2022-03-15T05:38:12.142 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/mfd/lpc_ich.ko 2022-03-15T05:38:12.142 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/mfd/lpc_sch.ko 2022-03-15T05:38:12.142 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/mfd/mfd-core.ko 2022-03-15T05:38:12.142 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/mfd/sm501.ko 2022-03-15T05:38:12.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/mfd/viperboard.ko 2022-03-15T05:38:12.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/mfd/vx855.ko 2022-03-15T05:38:12.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/mfd/wl1273-core.ko 2022-03-15T05:38:12.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc 2022-03-15T05:38:12.143 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/altera-stapl 2022-03-15T05:38:12.144 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2022-03-15T05:38:12.144 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/apds9802als.ko 2022-03-15T05:38:12.144 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/apds990x.ko 2022-03-15T05:38:12.144 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/bh1770glc.ko 2022-03-15T05:38:12.144 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/cb710 2022-03-15T05:38:12.145 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/cb710/cb710.ko 2022-03-15T05:38:12.145 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/eeprom 2022-03-15T05:38:12.145 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/eeprom/at24.ko 2022-03-15T05:38:12.145 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/eeprom/eeprom.ko 2022-03-15T05:38:12.146 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2022-03-15T05:38:12.146 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/eeprom/max6875.ko 2022-03-15T05:38:12.146 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/enclosure.ko 2022-03-15T05:38:12.146 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/hpilo.ko 2022-03-15T05:38:12.146 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/isl29003.ko 2022-03-15T05:38:12.147 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/isl29020.ko 2022-03-15T05:38:12.147 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/lis3lv02d 2022-03-15T05:38:12.147 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2022-03-15T05:38:12.147 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2022-03-15T05:38:12.147 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/mei 2022-03-15T05:38:12.148 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/mei/mei-me.ko 2022-03-15T05:38:12.148 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/mei/mei-txe.ko 2022-03-15T05:38:12.148 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/mei/mei.ko 2022-03-15T05:38:12.148 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/sgi-gru 2022-03-15T05:38:12.149 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/sgi-gru/gru.ko 2022-03-15T05:38:12.149 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/sgi-xp 2022-03-15T05:38:12.149 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/sgi-xp/xp.ko 2022-03-15T05:38:12.149 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/sgi-xp/xpc.ko 2022-03-15T05:38:12.149 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/sgi-xp/xpnet.ko 2022-03-15T05:38:12.150 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/tifm_7xx1.ko 2022-03-15T05:38:12.150 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/tifm_core.ko 2022-03-15T05:38:12.150 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/tsl2550.ko 2022-03-15T05:38:12.150 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/vmw_balloon.ko 2022-03-15T05:38:12.151 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/vmw_vmci 2022-03-15T05:38:12.151 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2022-03-15T05:38:12.151 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net 2022-03-15T05:38:12.151 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/bonding 2022-03-15T05:38:12.151 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/bonding/bonding.ko 2022-03-15T05:38:12.152 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/dsa 2022-03-15T05:38:12.152 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/dsa/b53 2022-03-15T05:38:12.152 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/dsa/b53/b53_common.ko 2022-03-15T05:38:12.152 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/dsa/bcm-sf2.ko 2022-03-15T05:38:12.152 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/dsa/mv88e6060.ko 2022-03-15T05:38:12.153 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/dsa/mv88e6xxx 2022-03-15T05:38:12.153 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2022-03-15T05:38:12.153 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/dummy.ko 2022-03-15T05:38:12.153 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/eql.ko 2022-03-15T05:38:12.154 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet 2022-03-15T05:38:12.154 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/3com 2022-03-15T05:38:12.154 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2022-03-15T05:38:12.154 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2022-03-15T05:38:12.154 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/3com/3c59x.ko 2022-03-15T05:38:12.155 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/3com/typhoon.ko 2022-03-15T05:38:12.155 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/8390 2022-03-15T05:38:12.155 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/8390/8390.ko 2022-03-15T05:38:12.155 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2022-03-15T05:38:12.156 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2022-03-15T05:38:12.156 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2022-03-15T05:38:12.156 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/adaptec 2022-03-15T05:38:12.156 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/adaptec/starfire.ko 2022-03-15T05:38:12.156 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/agere 2022-03-15T05:38:12.157 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/agere/et131x.ko 2022-03-15T05:38:12.157 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/alteon 2022-03-15T05:38:12.157 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/alteon/acenic.ko 2022-03-15T05:38:12.157 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/altera 2022-03-15T05:38:12.157 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/altera/altera_tse.ko 2022-03-15T05:38:12.158 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/amd 2022-03-15T05:38:12.158 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/amd/amd8111e.ko 2022-03-15T05:38:12.158 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2022-03-15T05:38:12.158 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/amd/pcnet32.ko 2022-03-15T05:38:12.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/atheros 2022-03-15T05:38:12.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/atheros/alx 2022-03-15T05:38:12.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2022-03-15T05:38:12.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/atheros/atl1c 2022-03-15T05:38:12.159 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2022-03-15T05:38:12.160 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/atheros/atl1e 2022-03-15T05:38:12.160 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2022-03-15T05:38:12.160 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/atheros/atlx 2022-03-15T05:38:12.160 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2022-03-15T05:38:12.160 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2022-03-15T05:38:12.161 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/broadcom 2022-03-15T05:38:12.161 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/broadcom/b44.ko 2022-03-15T05:38:12.161 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2022-03-15T05:38:12.161 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/broadcom/bnx2x 2022-03-15T05:38:12.162 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2022-03-15T05:38:12.162 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/broadcom/cnic.ko 2022-03-15T05:38:12.162 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/broadcom/genet 2022-03-15T05:38:12.162 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2022-03-15T05:38:12.163 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/broadcom/tg3.ko 2022-03-15T05:38:12.163 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/brocade 2022-03-15T05:38:12.163 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/brocade/bna 2022-03-15T05:38:12.163 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2022-03-15T05:38:12.163 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio 2022-03-15T05:38:12.164 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio/cxgb 2022-03-15T05:38:12.164 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2022-03-15T05:38:12.164 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio/cxgb3 2022-03-15T05:38:12.164 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2022-03-15T05:38:12.164 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio/cxgb4 2022-03-15T05:38:12.165 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2022-03-15T05:38:12.165 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2022-03-15T05:38:12.165 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2022-03-15T05:38:12.165 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio/libcxgb 2022-03-15T05:38:12.166 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2022-03-15T05:38:12.166 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/cisco 2022-03-15T05:38:12.166 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/cisco/enic 2022-03-15T05:38:12.166 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2022-03-15T05:38:12.166 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dec 2022-03-15T05:38:12.167 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dec/tulip 2022-03-15T05:38:12.167 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2022-03-15T05:38:12.167 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dec/tulip/de4x5.ko 2022-03-15T05:38:12.167 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2022-03-15T05:38:12.168 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2022-03-15T05:38:12.168 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2022-03-15T05:38:12.168 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2022-03-15T05:38:12.168 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2022-03-15T05:38:12.168 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dlink 2022-03-15T05:38:12.169 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dlink/dl2k.ko 2022-03-15T05:38:12.169 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dlink/sundance.ko 2022-03-15T05:38:12.169 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/dnet.ko 2022-03-15T05:38:12.169 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/emulex 2022-03-15T05:38:12.169 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/emulex/benet 2022-03-15T05:38:12.170 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2022-03-15T05:38:12.170 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/ethoc.ko 2022-03-15T05:38:12.170 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/fealnx.ko 2022-03-15T05:38:12.170 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel 2022-03-15T05:38:12.171 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/e100.ko 2022-03-15T05:38:12.171 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/e1000 2022-03-15T05:38:12.171 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2022-03-15T05:38:12.171 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/e1000e 2022-03-15T05:38:12.172 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2022-03-15T05:38:12.172 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/fm10k 2022-03-15T05:38:12.172 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2022-03-15T05:38:12.172 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/i40e 2022-03-15T05:38:12.172 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2022-03-15T05:38:12.173 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/iavf 2022-03-15T05:38:12.173 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2022-03-15T05:38:12.173 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/igb 2022-03-15T05:38:12.173 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/igb/igb.ko 2022-03-15T05:38:12.173 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/igbvf 2022-03-15T05:38:12.174 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2022-03-15T05:38:12.174 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/ixgb 2022-03-15T05:38:12.174 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2022-03-15T05:38:12.174 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/ixgbe 2022-03-15T05:38:12.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2022-03-15T05:38:12.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/ixgbevf 2022-03-15T05:38:12.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2022-03-15T05:38:12.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/jme.ko 2022-03-15T05:38:12.175 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/marvell 2022-03-15T05:38:12.176 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2022-03-15T05:38:12.176 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/marvell/skge.ko 2022-03-15T05:38:12.176 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/marvell/sky2.ko 2022-03-15T05:38:12.176 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/mellanox 2022-03-15T05:38:12.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/mellanox/mlx4 2022-03-15T05:38:12.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2022-03-15T05:38:12.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2022-03-15T05:38:12.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/mellanox/mlx5 2022-03-15T05:38:12.177 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/mellanox/mlx5/core 2022-03-15T05:38:12.178 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2022-03-15T05:38:12.178 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/micrel 2022-03-15T05:38:12.178 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2022-03-15T05:38:12.178 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/myricom 2022-03-15T05:38:12.179 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/myricom/myri10ge 2022-03-15T05:38:12.179 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2022-03-15T05:38:12.179 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/natsemi 2022-03-15T05:38:12.179 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2022-03-15T05:38:12.179 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2022-03-15T05:38:12.180 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/neterion 2022-03-15T05:38:12.180 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/neterion/s2io.ko 2022-03-15T05:38:12.180 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/neterion/vxge 2022-03-15T05:38:12.180 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/neterion/vxge/vxge.ko 2022-03-15T05:38:12.181 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/nvidia 2022-03-15T05:38:12.181 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2022-03-15T05:38:12.181 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/packetengines 2022-03-15T05:38:12.181 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2022-03-15T05:38:12.181 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2022-03-15T05:38:12.182 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/qlogic 2022-03-15T05:38:12.182 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/qlogic/netxen 2022-03-15T05:38:12.182 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2022-03-15T05:38:12.182 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2022-03-15T05:38:12.183 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/qlogic/qlcnic 2022-03-15T05:38:12.183 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2022-03-15T05:38:12.183 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/rdc 2022-03-15T05:38:12.183 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/rdc/r6040.ko 2022-03-15T05:38:12.183 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/realtek 2022-03-15T05:38:12.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/realtek/8139cp.ko 2022-03-15T05:38:12.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/realtek/8139too.ko 2022-03-15T05:38:12.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/realtek/atp.ko 2022-03-15T05:38:12.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/realtek/r8169.ko 2022-03-15T05:38:12.184 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/rocker 2022-03-15T05:38:12.185 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/rocker/rocker.ko 2022-03-15T05:38:12.185 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/sfc 2022-03-15T05:38:12.185 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/sfc/sfc.ko 2022-03-15T05:38:12.185 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/silan 2022-03-15T05:38:12.186 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/silan/sc92031.ko 2022-03-15T05:38:12.186 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/sis 2022-03-15T05:38:12.186 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/sis/sis190.ko 2022-03-15T05:38:12.186 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/sis/sis900.ko 2022-03-15T05:38:12.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/smsc 2022-03-15T05:38:12.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/smsc/epic100.ko 2022-03-15T05:38:12.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2022-03-15T05:38:12.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2022-03-15T05:38:12.187 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2022-03-15T05:38:12.188 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/stmicro 2022-03-15T05:38:12.188 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/stmicro/stmmac 2022-03-15T05:38:12.188 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2022-03-15T05:38:12.188 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2022-03-15T05:38:12.188 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/sun 2022-03-15T05:38:12.189 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/sun/cassini.ko 2022-03-15T05:38:12.189 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/sun/niu.ko 2022-03-15T05:38:12.189 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/sun/sungem.ko 2022-03-15T05:38:12.189 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/sun/sunhme.ko 2022-03-15T05:38:12.190 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/tehuti 2022-03-15T05:38:12.190 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2022-03-15T05:38:12.190 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/ti 2022-03-15T05:38:12.190 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/ti/tlan.ko 2022-03-15T05:38:12.191 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/via 2022-03-15T05:38:12.191 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/via/via-rhine.ko 2022-03-15T05:38:12.191 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/via/via-velocity.ko 2022-03-15T05:38:12.191 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/wiznet 2022-03-15T05:38:12.191 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/wiznet/w5100.ko 2022-03-15T05:38:12.192 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/wiznet/w5300.ko 2022-03-15T05:38:12.192 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/xircom 2022-03-15T05:38:12.192 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2022-03-15T05:38:12.192 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/geneve.ko 2022-03-15T05:38:12.193 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/hyperv 2022-03-15T05:38:12.193 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/hyperv/hv_netvsc.ko 2022-03-15T05:38:12.193 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ieee802154 2022-03-15T05:38:12.193 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ieee802154/fakelb.ko 2022-03-15T05:38:12.193 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ifb.ko 2022-03-15T05:38:12.194 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ipvlan 2022-03-15T05:38:12.194 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ipvlan/ipvlan.ko 2022-03-15T05:38:12.194 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/macvlan.ko 2022-03-15T05:38:12.194 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/macvtap.ko 2022-03-15T05:38:12.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/mdio 2022-03-15T05:38:12.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/mdio.ko 2022-03-15T05:38:12.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2022-03-15T05:38:12.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/mdio/mdio-bitbang.ko 2022-03-15T05:38:12.195 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/mii.ko 2022-03-15T05:38:12.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/net_failover.ko 2022-03-15T05:38:12.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/netconsole.ko 2022-03-15T05:38:12.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/nlmon.ko 2022-03-15T05:38:12.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/pcs 2022-03-15T05:38:12.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/pcs/pcs_xpcs.ko 2022-03-15T05:38:12.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy 2022-03-15T05:38:12.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/amd.ko 2022-03-15T05:38:12.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/bcm-phy-lib.ko 2022-03-15T05:38:12.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/bcm7xxx.ko 2022-03-15T05:38:12.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/bcm87xx.ko 2022-03-15T05:38:12.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/broadcom.ko 2022-03-15T05:38:12.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/cicada.ko 2022-03-15T05:38:12.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/davicom.ko 2022-03-15T05:38:12.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/dp83640.ko 2022-03-15T05:38:12.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/et1011c.ko 2022-03-15T05:38:12.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/icplus.ko 2022-03-15T05:38:12.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/lxt.ko 2022-03-15T05:38:12.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/marvell.ko 2022-03-15T05:38:12.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/micrel.ko 2022-03-15T05:38:12.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/national.ko 2022-03-15T05:38:12.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/phylink.ko 2022-03-15T05:38:12.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/qsemi.ko 2022-03-15T05:38:12.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/realtek.ko 2022-03-15T05:38:12.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/smsc.ko 2022-03-15T05:38:12.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/ste10Xp.ko 2022-03-15T05:38:12.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/phy/vitesse.ko 2022-03-15T05:38:12.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ppp 2022-03-15T05:38:12.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ppp/bsd_comp.ko 2022-03-15T05:38:12.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ppp/ppp_async.ko 2022-03-15T05:38:12.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ppp/ppp_deflate.ko 2022-03-15T05:38:12.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ppp/ppp_generic.ko 2022-03-15T05:38:12.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ppp/ppp_mppe.ko 2022-03-15T05:38:12.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ppp/ppp_synctty.ko 2022-03-15T05:38:12.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ppp/pppoe.ko 2022-03-15T05:38:12.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ppp/pppox.ko 2022-03-15T05:38:12.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/ppp/pptp.ko 2022-03-15T05:38:12.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/slip 2022-03-15T05:38:12.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/slip/slhc.ko 2022-03-15T05:38:12.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/slip/slip.ko 2022-03-15T05:38:12.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/sungem_phy.ko 2022-03-15T05:38:12.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/tap.ko 2022-03-15T05:38:12.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/team 2022-03-15T05:38:12.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/team/team.ko 2022-03-15T05:38:12.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/team/team_mode_activebackup.ko 2022-03-15T05:38:12.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/team/team_mode_broadcast.ko 2022-03-15T05:38:12.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/team/team_mode_loadbalance.ko 2022-03-15T05:38:12.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/team/team_mode_random.ko 2022-03-15T05:38:12.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/team/team_mode_roundrobin.ko 2022-03-15T05:38:12.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/tun.ko 2022-03-15T05:38:12.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/veth.ko 2022-03-15T05:38:12.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/virtio_net.ko 2022-03-15T05:38:12.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/vmxnet3 2022-03-15T05:38:12.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/vmxnet3/vmxnet3.ko 2022-03-15T05:38:12.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/vxlan.ko 2022-03-15T05:38:12.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/xen-netback 2022-03-15T05:38:12.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/xen-netback/xen-netback.ko 2022-03-15T05:38:12.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/net/xen-netfront.ko 2022-03-15T05:38:12.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ntb 2022-03-15T05:38:12.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ntb/ntb.ko 2022-03-15T05:38:12.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/nvme 2022-03-15T05:38:12.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/nvme/host 2022-03-15T05:38:12.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/nvme/host/nvme-core.ko 2022-03-15T05:38:12.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/nvme/host/nvme.ko 2022-03-15T05:38:12.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/parport 2022-03-15T05:38:12.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/parport/parport.ko 2022-03-15T05:38:12.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/parport/parport_cs.ko 2022-03-15T05:38:12.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/parport/parport_pc.ko 2022-03-15T05:38:12.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/parport/parport_serial.ko 2022-03-15T05:38:12.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pci 2022-03-15T05:38:12.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pci/hotplug 2022-03-15T05:38:12.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2022-03-15T05:38:12.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pci/pcie 2022-03-15T05:38:12.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pci/pcie/aer_inject.ko 2022-03-15T05:38:12.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pci/xen-pcifront.ko 2022-03-15T05:38:12.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pcmcia 2022-03-15T05:38:12.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pcmcia/i82092.ko 2022-03-15T05:38:12.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pcmcia/pd6729.ko 2022-03-15T05:38:12.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pcmcia/yenta_socket.ko 2022-03-15T05:38:12.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pinctrl 2022-03-15T05:38:12.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pinctrl/intel 2022-03-15T05:38:12.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2022-03-15T05:38:12.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform 2022-03-15T05:38:12.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86 2022-03-15T05:38:12.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/acer-wmi.ko 2022-03-15T05:38:12.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/acerhdf.ko 2022-03-15T05:38:12.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/apple-gmux.ko 2022-03-15T05:38:12.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/asus-laptop.ko 2022-03-15T05:38:12.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/asus-nb-wmi.ko 2022-03-15T05:38:12.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/asus-wmi.ko 2022-03-15T05:38:12.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/classmate-laptop.ko 2022-03-15T05:38:12.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/eeepc-laptop.ko 2022-03-15T05:38:12.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/eeepc-wmi.ko 2022-03-15T05:38:12.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/fujitsu-laptop.ko 2022-03-15T05:38:12.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/fujitsu-tablet.ko 2022-03-15T05:38:12.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/hdaps.ko 2022-03-15T05:38:12.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/hp-wmi.ko 2022-03-15T05:38:12.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/hp_accel.ko 2022-03-15T05:38:12.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/intel 2022-03-15T05:38:12.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/intel/intel-rst.ko 2022-03-15T05:38:12.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/intel_ips.ko 2022-03-15T05:38:12.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/msi-wmi.ko 2022-03-15T05:38:12.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/mxm-wmi.ko 2022-03-15T05:38:12.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/panasonic-laptop.ko 2022-03-15T05:38:12.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/samsung-laptop.ko 2022-03-15T05:38:12.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/samsung-q10.ko 2022-03-15T05:38:12.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/topstar-laptop.ko 2022-03-15T05:38:12.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2022-03-15T05:38:12.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/toshiba_haps.ko 2022-03-15T05:38:12.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/wmi-bmof.ko 2022-03-15T05:38:12.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/platform/x86/wmi.ko 2022-03-15T05:38:12.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/powercap 2022-03-15T05:38:12.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/powercap/intel_rapl_common.ko 2022-03-15T05:38:12.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/powercap/intel_rapl_msr.ko 2022-03-15T05:38:12.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pps 2022-03-15T05:38:12.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pps/clients 2022-03-15T05:38:12.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pps/clients/pps-gpio.ko 2022-03-15T05:38:12.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pps/clients/pps-ldisc.ko 2022-03-15T05:38:12.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pps/clients/pps_parport.ko 2022-03-15T05:38:12.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/pps/pps_core.ko 2022-03-15T05:38:12.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ptp 2022-03-15T05:38:12.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ptp/ptp.ko 2022-03-15T05:38:12.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ptp/ptp_kvm.ko 2022-03-15T05:38:12.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc 2022-03-15T05:38:12.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-bq32k.ko 2022-03-15T05:38:12.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-bq4802.ko 2022-03-15T05:38:12.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-ds1286.ko 2022-03-15T05:38:12.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-ds1307.ko 2022-03-15T05:38:12.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-ds1374.ko 2022-03-15T05:38:12.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-ds1511.ko 2022-03-15T05:38:12.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-ds1553.ko 2022-03-15T05:38:12.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-ds1672.ko 2022-03-15T05:38:12.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-ds1742.ko 2022-03-15T05:38:12.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-ds2404.ko 2022-03-15T05:38:12.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-ds3232.ko 2022-03-15T05:38:12.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-em3027.ko 2022-03-15T05:38:12.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-fm3130.ko 2022-03-15T05:38:12.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-isl12022.ko 2022-03-15T05:38:12.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-isl1208.ko 2022-03-15T05:38:12.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-m41t80.ko 2022-03-15T05:38:12.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-m48t35.ko 2022-03-15T05:38:12.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-m48t59.ko 2022-03-15T05:38:12.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-max6900.ko 2022-03-15T05:38:12.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-msm6242.ko 2022-03-15T05:38:12.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-pcf2127.ko 2022-03-15T05:38:12.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-pcf85063.ko 2022-03-15T05:38:12.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-pcf8523.ko 2022-03-15T05:38:12.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-pcf8563.ko 2022-03-15T05:38:12.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-pcf8583.ko 2022-03-15T05:38:12.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-rp5c01.ko 2022-03-15T05:38:12.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-rs5c372.ko 2022-03-15T05:38:12.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-rv3029c2.ko 2022-03-15T05:38:12.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-rx8025.ko 2022-03-15T05:38:12.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-rx8581.ko 2022-03-15T05:38:12.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-stk17ta8.ko 2022-03-15T05:38:12.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-v3020.ko 2022-03-15T05:38:12.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/rtc/rtc-x1205.ko 2022-03-15T05:38:12.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi 2022-03-15T05:38:12.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/3w-9xxx.ko 2022-03-15T05:38:12.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/3w-sas.ko 2022-03-15T05:38:12.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/3w-xxxx.ko 2022-03-15T05:38:12.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/BusLogic.ko 2022-03-15T05:38:12.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/a100u2w.ko 2022-03-15T05:38:12.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/aacraid 2022-03-15T05:38:12.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/aacraid/aacraid.ko 2022-03-15T05:38:12.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/advansys.ko 2022-03-15T05:38:12.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/aic7xxx 2022-03-15T05:38:12.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2022-03-15T05:38:12.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2022-03-15T05:38:12.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/am53c974.ko 2022-03-15T05:38:12.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/arcmsr 2022-03-15T05:38:12.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/arcmsr/arcmsr.ko 2022-03-15T05:38:12.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/atp870u.ko 2022-03-15T05:38:12.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/be2iscsi 2022-03-15T05:38:12.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2022-03-15T05:38:12.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/bfa 2022-03-15T05:38:12.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/bfa/bfa.ko 2022-03-15T05:38:12.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/bnx2fc 2022-03-15T05:38:12.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2022-03-15T05:38:12.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/bnx2i 2022-03-15T05:38:12.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/bnx2i/bnx2i.ko 2022-03-15T05:38:12.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/ch.ko 2022-03-15T05:38:12.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/csiostor 2022-03-15T05:38:12.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/csiostor/csiostor.ko 2022-03-15T05:38:12.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/cxgbi 2022-03-15T05:38:12.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/cxgbi/cxgb3i 2022-03-15T05:38:12.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2022-03-15T05:38:12.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/cxgbi/cxgb4i 2022-03-15T05:38:12.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2022-03-15T05:38:12.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2022-03-15T05:38:12.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/dc395x.ko 2022-03-15T05:38:12.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/device_handler 2022-03-15T05:38:12.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2022-03-15T05:38:12.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2022-03-15T05:38:12.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2022-03-15T05:38:12.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2022-03-15T05:38:12.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/dmx3191d.ko 2022-03-15T05:38:12.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/esas2r 2022-03-15T05:38:12.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/esas2r/esas2r.ko 2022-03-15T05:38:12.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/esp_scsi.ko 2022-03-15T05:38:12.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/fcoe 2022-03-15T05:38:12.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/fcoe/fcoe.ko 2022-03-15T05:38:12.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/fcoe/libfcoe.ko 2022-03-15T05:38:12.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/fnic 2022-03-15T05:38:12.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/fnic/fnic.ko 2022-03-15T05:38:12.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/hpsa.ko 2022-03-15T05:38:12.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/hptiop.ko 2022-03-15T05:38:12.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/hv_storvsc.ko 2022-03-15T05:38:12.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/initio.ko 2022-03-15T05:38:12.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/ipr.ko 2022-03-15T05:38:12.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/ips.ko 2022-03-15T05:38:12.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/isci 2022-03-15T05:38:12.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/isci/isci.ko 2022-03-15T05:38:12.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2022-03-15T05:38:12.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/iscsi_tcp.ko 2022-03-15T05:38:12.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/libfc 2022-03-15T05:38:12.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/libfc/libfc.ko 2022-03-15T05:38:12.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/libiscsi.ko 2022-03-15T05:38:12.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/libiscsi_tcp.ko 2022-03-15T05:38:12.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/libsas 2022-03-15T05:38:12.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/libsas/libsas.ko 2022-03-15T05:38:12.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/lpfc 2022-03-15T05:38:12.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/lpfc/lpfc.ko 2022-03-15T05:38:12.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/megaraid 2022-03-15T05:38:12.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/megaraid.ko 2022-03-15T05:38:12.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2022-03-15T05:38:12.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2022-03-15T05:38:12.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2022-03-15T05:38:12.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/mpt3sas 2022-03-15T05:38:12.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2022-03-15T05:38:12.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/mvsas 2022-03-15T05:38:12.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/mvsas/mvsas.ko 2022-03-15T05:38:12.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/mvumi.ko 2022-03-15T05:38:12.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/pm8001 2022-03-15T05:38:12.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/pm8001/pm80xx.ko 2022-03-15T05:38:12.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/pmcraid.ko 2022-03-15T05:38:12.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/qla1280.ko 2022-03-15T05:38:12.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/qla2xxx 2022-03-15T05:38:12.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2022-03-15T05:38:12.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2022-03-15T05:38:12.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/qla4xxx 2022-03-15T05:38:12.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2022-03-15T05:38:12.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/raid_class.ko 2022-03-15T05:38:12.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/scsi_debug.ko 2022-03-15T05:38:12.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/scsi_transport_fc.ko 2022-03-15T05:38:12.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/scsi_transport_iscsi.ko 2022-03-15T05:38:12.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/scsi_transport_sas.ko 2022-03-15T05:38:12.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/scsi_transport_spi.ko 2022-03-15T05:38:12.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/scsi_transport_srp.ko 2022-03-15T05:38:12.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/ses.ko 2022-03-15T05:38:12.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/st.ko 2022-03-15T05:38:12.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/stex.ko 2022-03-15T05:38:12.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/sym53c8xx_2 2022-03-15T05:38:12.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2022-03-15T05:38:12.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/ufs 2022-03-15T05:38:12.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/ufs/ufshcd-core.ko 2022-03-15T05:38:12.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/ufs/ufshcd-pci.ko 2022-03-15T05:38:12.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/virtio_scsi.ko 2022-03-15T05:38:12.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/vmw_pvscsi.ko 2022-03-15T05:38:12.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/scsi/wd719x.ko 2022-03-15T05:38:12.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ssb 2022-03-15T05:38:12.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/ssb/ssb.ko 2022-03-15T05:38:12.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target 2022-03-15T05:38:12.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/iscsi 2022-03-15T05:38:12.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2022-03-15T05:38:12.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/loopback 2022-03-15T05:38:12.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/loopback/tcm_loop.ko 2022-03-15T05:38:12.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/target_core_file.ko 2022-03-15T05:38:12.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/target_core_iblock.ko 2022-03-15T05:38:12.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/target_core_mod.ko 2022-03-15T05:38:12.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/target_core_pscsi.ko 2022-03-15T05:38:12.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/target_core_user.ko 2022-03-15T05:38:12.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/tcm_fc 2022-03-15T05:38:12.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/target/tcm_fc/tcm_fc.ko 2022-03-15T05:38:12.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal 2022-03-15T05:38:12.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel 2022-03-15T05:38:12.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal 2022-03-15T05:38:12.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2022-03-15T05:38:12.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2022-03-15T05:38:12.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2022-03-15T05:38:12.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2022-03-15T05:38:12.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2022-03-15T05:38:12.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2022-03-15T05:38:12.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2022-03-15T05:38:12.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2022-03-15T05:38:12.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2022-03-15T05:38:12.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2022-03-15T05:38:12.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2022-03-15T05:38:12.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2022-03-15T05:38:12.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2022-03-15T05:38:12.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2022-03-15T05:38:12.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2022-03-15T05:38:12.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty 2022-03-15T05:38:12.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/ipwireless 2022-03-15T05:38:12.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/ipwireless/ipwireless.ko 2022-03-15T05:38:12.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/n_gsm.ko 2022-03-15T05:38:12.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/n_hdlc.ko 2022-03-15T05:38:12.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/nozomi.ko 2022-03-15T05:38:12.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/serial 2022-03-15T05:38:12.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/serial/8250 2022-03-15T05:38:12.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/serial/8250/serial_cs.ko 2022-03-15T05:38:12.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/serial/arc_uart.ko 2022-03-15T05:38:12.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/serial/jsm 2022-03-15T05:38:12.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/serial/jsm/jsm.ko 2022-03-15T05:38:12.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/tty/synclink_gt.ko 2022-03-15T05:38:12.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/uio 2022-03-15T05:38:12.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/uio/uio.ko 2022-03-15T05:38:12.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/uio/uio_aec.ko 2022-03-15T05:38:12.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/uio/uio_cif.ko 2022-03-15T05:38:12.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/uio/uio_pci_generic.ko 2022-03-15T05:38:12.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/uio/uio_sercos3.ko 2022-03-15T05:38:12.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb 2022-03-15T05:38:12.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/class 2022-03-15T05:38:12.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/class/cdc-acm.ko 2022-03-15T05:38:12.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/class/cdc-wdm.ko 2022-03-15T05:38:12.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/class/usblp.ko 2022-03-15T05:38:12.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/class/usbtmc.ko 2022-03-15T05:38:12.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/host 2022-03-15T05:38:12.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/host/sl811-hcd.ko 2022-03-15T05:38:12.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/host/u132-hcd.ko 2022-03-15T05:38:12.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/image 2022-03-15T05:38:12.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/image/mdc800.ko 2022-03-15T05:38:12.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/image/microtek.ko 2022-03-15T05:38:12.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc 2022-03-15T05:38:12.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/adutux.ko 2022-03-15T05:38:12.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/appledisplay.ko 2022-03-15T05:38:12.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/emi26.ko 2022-03-15T05:38:12.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/emi62.ko 2022-03-15T05:38:12.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/ezusb.ko 2022-03-15T05:38:12.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/ftdi-elan.ko 2022-03-15T05:38:12.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/idmouse.ko 2022-03-15T05:38:12.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/iowarrior.ko 2022-03-15T05:38:12.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/isight_firmware.ko 2022-03-15T05:38:12.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/ldusb.ko 2022-03-15T05:38:12.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/legousbtower.ko 2022-03-15T05:38:12.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/sisusbvga 2022-03-15T05:38:12.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2022-03-15T05:38:12.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/trancevibrator.ko 2022-03-15T05:38:12.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/usb3503.ko 2022-03-15T05:38:12.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/usblcd.ko 2022-03-15T05:38:12.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/usbsevseg.ko 2022-03-15T05:38:12.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/uss720.ko 2022-03-15T05:38:12.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/misc/yurex.ko 2022-03-15T05:38:12.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/phy 2022-03-15T05:38:12.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/phy/phy-generic.ko 2022-03-15T05:38:12.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial 2022-03-15T05:38:12.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/aircable.ko 2022-03-15T05:38:12.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/ark3116.ko 2022-03-15T05:38:12.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/belkin_sa.ko 2022-03-15T05:38:12.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/ch341.ko 2022-03-15T05:38:12.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/cp210x.ko 2022-03-15T05:38:12.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/cyberjack.ko 2022-03-15T05:38:12.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/cypress_m8.ko 2022-03-15T05:38:12.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/digi_acceleport.ko 2022-03-15T05:38:12.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/empeg.ko 2022-03-15T05:38:12.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/ftdi_sio.ko 2022-03-15T05:38:12.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/garmin_gps.ko 2022-03-15T05:38:12.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/io_edgeport.ko 2022-03-15T05:38:12.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/io_ti.ko 2022-03-15T05:38:12.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/ipaq.ko 2022-03-15T05:38:12.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/ipw.ko 2022-03-15T05:38:12.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/ir-usb.ko 2022-03-15T05:38:12.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/iuu_phoenix.ko 2022-03-15T05:38:12.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/keyspan.ko 2022-03-15T05:38:12.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/keyspan_pda.ko 2022-03-15T05:38:12.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/kl5kusb105.ko 2022-03-15T05:38:12.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/kobil_sct.ko 2022-03-15T05:38:12.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/mct_u232.ko 2022-03-15T05:38:12.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/mos7720.ko 2022-03-15T05:38:12.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/mos7840.ko 2022-03-15T05:38:12.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/navman.ko 2022-03-15T05:38:12.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/omninet.ko 2022-03-15T05:38:12.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/opticon.ko 2022-03-15T05:38:12.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/option.ko 2022-03-15T05:38:12.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/oti6858.ko 2022-03-15T05:38:12.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/pl2303.ko 2022-03-15T05:38:12.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/qcaux.ko 2022-03-15T05:38:12.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/qcserial.ko 2022-03-15T05:38:12.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/quatech2.ko 2022-03-15T05:38:12.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/safe_serial.ko 2022-03-15T05:38:12.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/sierra.ko 2022-03-15T05:38:12.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/spcp8x5.ko 2022-03-15T05:38:12.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/ssu100.ko 2022-03-15T05:38:12.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/symbolserial.ko 2022-03-15T05:38:12.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2022-03-15T05:38:12.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/usb-serial-simple.ko 2022-03-15T05:38:12.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/usb_debug.ko 2022-03-15T05:38:12.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/usb_wwan.ko 2022-03-15T05:38:12.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/visor.ko 2022-03-15T05:38:12.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/whiteheat.ko 2022-03-15T05:38:12.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/serial/xsens_mt.ko 2022-03-15T05:38:12.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage 2022-03-15T05:38:12.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/uas.ko 2022-03-15T05:38:12.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-alauda.ko 2022-03-15T05:38:12.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-cypress.ko 2022-03-15T05:38:12.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-datafab.ko 2022-03-15T05:38:12.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-eneub6250.ko 2022-03-15T05:38:12.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-freecom.ko 2022-03-15T05:38:12.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-isd200.ko 2022-03-15T05:38:12.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-jumpshot.ko 2022-03-15T05:38:12.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-karma.ko 2022-03-15T05:38:12.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-onetouch.ko 2022-03-15T05:38:12.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-realtek.ko 2022-03-15T05:38:12.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-sddr09.ko 2022-03-15T05:38:12.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-sddr55.ko 2022-03-15T05:38:12.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/ums-usbat.ko 2022-03-15T05:38:12.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/storage/usb-storage.ko 2022-03-15T05:38:12.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/usbip 2022-03-15T05:38:12.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/usbip/usbip-core.ko 2022-03-15T05:38:12.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/usbip/usbip-host.ko 2022-03-15T05:38:12.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/usb/usbip/vhci-hcd.ko 2022-03-15T05:38:12.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vfio 2022-03-15T05:38:12.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vfio/pci 2022-03-15T05:38:12.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vfio/pci/vfio-pci-core.ko 2022-03-15T05:38:12.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vfio/pci/vfio-pci.ko 2022-03-15T05:38:12.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vfio/vfio.ko 2022-03-15T05:38:12.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vfio/vfio_iommu_type1.ko 2022-03-15T05:38:12.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vfio/vfio_virqfd.ko 2022-03-15T05:38:12.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vhost 2022-03-15T05:38:12.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vhost/vhost.ko 2022-03-15T05:38:12.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vhost/vhost_iotlb.ko 2022-03-15T05:38:12.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vhost/vhost_net.ko 2022-03-15T05:38:12.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/vhost/vhost_scsi.ko 2022-03-15T05:38:12.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/video 2022-03-15T05:38:12.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/video/backlight 2022-03-15T05:38:12.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/video/backlight/apple_bl.ko 2022-03-15T05:38:12.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/video/backlight/lcd.ko 2022-03-15T05:38:12.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/video/backlight/platform_lcd.ko 2022-03-15T05:38:12.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/virtio 2022-03-15T05:38:12.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/virtio/virtio.ko 2022-03-15T05:38:12.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/virtio/virtio_balloon.ko 2022-03-15T05:38:12.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/virtio/virtio_mmio.ko 2022-03-15T05:38:12.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/virtio/virtio_pci.ko 2022-03-15T05:38:12.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2022-03-15T05:38:12.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2022-03-15T05:38:12.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/virtio/virtio_ring.ko 2022-03-15T05:38:12.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1 2022-03-15T05:38:12.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/masters 2022-03-15T05:38:12.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/masters/ds1wm.ko 2022-03-15T05:38:12.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/masters/ds2482.ko 2022-03-15T05:38:12.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/masters/ds2490.ko 2022-03-15T05:38:12.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves 2022-03-15T05:38:12.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_ds2406.ko 2022-03-15T05:38:12.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_ds2408.ko 2022-03-15T05:38:12.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_ds2413.ko 2022-03-15T05:38:12.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_ds2423.ko 2022-03-15T05:38:12.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_ds2431.ko 2022-03-15T05:38:12.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_ds2433.ko 2022-03-15T05:38:12.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_ds2780.ko 2022-03-15T05:38:12.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_ds2781.ko 2022-03-15T05:38:12.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_ds28e04.ko 2022-03-15T05:38:12.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_smem.ko 2022-03-15T05:38:12.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/slaves/w1_therm.ko 2022-03-15T05:38:12.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/w1/wire.ko 2022-03-15T05:38:12.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog 2022-03-15T05:38:12.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/alim1535_wdt.ko 2022-03-15T05:38:12.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/alim7101_wdt.ko 2022-03-15T05:38:12.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/f71808e_wdt.ko 2022-03-15T05:38:12.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/hpwdt.ko 2022-03-15T05:38:12.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/i6300esb.ko 2022-03-15T05:38:12.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/iTCO_vendor_support.ko 2022-03-15T05:38:12.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/iTCO_wdt.ko 2022-03-15T05:38:12.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/ib700wdt.ko 2022-03-15T05:38:12.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/ibmasr.ko 2022-03-15T05:38:12.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/ie6xx_wdt.ko 2022-03-15T05:38:12.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/it8712f_wdt.ko 2022-03-15T05:38:12.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/it87_wdt.ko 2022-03-15T05:38:12.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/machzwd.ko 2022-03-15T05:38:12.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/nv_tco.ko 2022-03-15T05:38:12.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/pcwd_pci.ko 2022-03-15T05:38:12.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/pcwd_usb.ko 2022-03-15T05:38:12.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2022-03-15T05:38:12.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/sch311x_wdt.ko 2022-03-15T05:38:12.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/softdog.ko 2022-03-15T05:38:12.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/sp5100_tco.ko 2022-03-15T05:38:12.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/via_wdt.ko 2022-03-15T05:38:12.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/w83627hf_wdt.ko 2022-03-15T05:38:12.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/w83877f_wdt.ko 2022-03-15T05:38:12.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/w83977f_wdt.ko 2022-03-15T05:38:12.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/wdt_pci.ko 2022-03-15T05:38:12.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/watchdog/xen_wdt.ko 2022-03-15T05:38:12.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/xen 2022-03-15T05:38:12.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/xen/xen-acpi-processor.ko 2022-03-15T05:38:12.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/xen/xen-evtchn.ko 2022-03-15T05:38:12.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/xen/xen-gntalloc.ko 2022-03-15T05:38:12.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/xen/xen-gntdev.ko 2022-03-15T05:38:12.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/xen/xen-pciback 2022-03-15T05:38:12.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2022-03-15T05:38:12.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/xen/xen-privcmd.ko 2022-03-15T05:38:12.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/xen/xenfs 2022-03-15T05:38:12.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/drivers/xen/xenfs/xenfs.ko 2022-03-15T05:38:12.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs 2022-03-15T05:38:12.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/9p 2022-03-15T05:38:12.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/9p/9p.ko 2022-03-15T05:38:12.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/affs 2022-03-15T05:38:12.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/affs/affs.ko 2022-03-15T05:38:12.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/befs 2022-03-15T05:38:12.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/befs/befs.ko 2022-03-15T05:38:12.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/binfmt_misc.ko 2022-03-15T05:38:12.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/btrfs 2022-03-15T05:38:12.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/btrfs/btrfs.ko 2022-03-15T05:38:12.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/cachefiles 2022-03-15T05:38:12.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/cachefiles/cachefiles.ko 2022-03-15T05:38:12.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ceph 2022-03-15T05:38:12.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ceph/ceph.ko 2022-03-15T05:38:12.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/cifs 2022-03-15T05:38:12.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/cifs/cifs.ko 2022-03-15T05:38:12.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/coda 2022-03-15T05:38:12.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/coda/coda.ko 2022-03-15T05:38:12.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/cramfs 2022-03-15T05:38:12.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/cramfs/cramfs.ko 2022-03-15T05:38:12.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/dlm 2022-03-15T05:38:12.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/dlm/dlm.ko 2022-03-15T05:38:12.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ecryptfs 2022-03-15T05:38:12.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ecryptfs/ecryptfs.ko 2022-03-15T05:38:12.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/f2fs 2022-03-15T05:38:12.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/f2fs/f2fs.ko 2022-03-15T05:38:12.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/fat 2022-03-15T05:38:12.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/fat/fat.ko 2022-03-15T05:38:12.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/fat/msdos.ko 2022-03-15T05:38:12.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/fat/vfat.ko 2022-03-15T05:38:12.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/fscache 2022-03-15T05:38:12.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/fscache/fscache.ko 2022-03-15T05:38:12.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/fuse 2022-03-15T05:38:12.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/fuse/cuse.ko 2022-03-15T05:38:12.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/fuse/fuse.ko 2022-03-15T05:38:12.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/gfs2 2022-03-15T05:38:12.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/gfs2/gfs2.ko 2022-03-15T05:38:12.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/hfs 2022-03-15T05:38:12.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/hfs/hfs.ko 2022-03-15T05:38:12.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/hfsplus 2022-03-15T05:38:12.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/hfsplus/hfsplus.ko 2022-03-15T05:38:12.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/isofs 2022-03-15T05:38:12.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/isofs/isofs.ko 2022-03-15T05:38:12.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/jfs 2022-03-15T05:38:12.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/jfs/jfs.ko 2022-03-15T05:38:12.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/lockd 2022-03-15T05:38:12.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/lockd/lockd.ko 2022-03-15T05:38:12.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/minix 2022-03-15T05:38:12.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/minix/minix.ko 2022-03-15T05:38:12.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/netfs 2022-03-15T05:38:12.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/netfs/netfs.ko 2022-03-15T05:38:12.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs 2022-03-15T05:38:12.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs/blocklayout 2022-03-15T05:38:12.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2022-03-15T05:38:12.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs/filelayout 2022-03-15T05:38:12.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2022-03-15T05:38:12.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs/flexfilelayout 2022-03-15T05:38:12.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2022-03-15T05:38:12.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs/nfs.ko 2022-03-15T05:38:12.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs/nfsv3.ko 2022-03-15T05:38:12.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs/nfsv4.ko 2022-03-15T05:38:12.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs_common 2022-03-15T05:38:12.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs_common/grace.ko 2022-03-15T05:38:12.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfs_common/nfs_acl.ko 2022-03-15T05:38:12.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfsd 2022-03-15T05:38:12.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nfsd/nfsd.ko 2022-03-15T05:38:12.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nilfs2 2022-03-15T05:38:12.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nilfs2/nilfs2.ko 2022-03-15T05:38:12.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls 2022-03-15T05:38:12.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-celtic.ko 2022-03-15T05:38:12.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-centeuro.ko 2022-03-15T05:38:12.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-croatian.ko 2022-03-15T05:38:12.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-cyrillic.ko 2022-03-15T05:38:12.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-gaelic.ko 2022-03-15T05:38:12.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-greek.ko 2022-03-15T05:38:12.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-iceland.ko 2022-03-15T05:38:12.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-inuit.ko 2022-03-15T05:38:12.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-roman.ko 2022-03-15T05:38:12.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-romanian.ko 2022-03-15T05:38:12.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/mac-turkish.ko 2022-03-15T05:38:12.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp1250.ko 2022-03-15T05:38:12.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp1251.ko 2022-03-15T05:38:12.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp1255.ko 2022-03-15T05:38:12.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp737.ko 2022-03-15T05:38:12.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp775.ko 2022-03-15T05:38:12.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp850.ko 2022-03-15T05:38:12.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp852.ko 2022-03-15T05:38:12.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp855.ko 2022-03-15T05:38:12.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp857.ko 2022-03-15T05:38:12.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp860.ko 2022-03-15T05:38:12.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp861.ko 2022-03-15T05:38:12.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp862.ko 2022-03-15T05:38:12.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp863.ko 2022-03-15T05:38:12.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp864.ko 2022-03-15T05:38:12.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp865.ko 2022-03-15T05:38:12.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp866.ko 2022-03-15T05:38:12.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp869.ko 2022-03-15T05:38:12.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp874.ko 2022-03-15T05:38:12.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp932.ko 2022-03-15T05:38:12.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp936.ko 2022-03-15T05:38:12.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp949.ko 2022-03-15T05:38:12.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_cp950.ko 2022-03-15T05:38:12.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_euc-jp.ko 2022-03-15T05:38:12.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-1.ko 2022-03-15T05:38:12.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-13.ko 2022-03-15T05:38:12.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-14.ko 2022-03-15T05:38:12.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-15.ko 2022-03-15T05:38:12.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-2.ko 2022-03-15T05:38:12.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-3.ko 2022-03-15T05:38:12.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-4.ko 2022-03-15T05:38:12.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-5.ko 2022-03-15T05:38:12.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-6.ko 2022-03-15T05:38:12.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-7.ko 2022-03-15T05:38:12.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_iso8859-9.ko 2022-03-15T05:38:12.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_koi8-r.ko 2022-03-15T05:38:12.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_koi8-ru.ko 2022-03-15T05:38:12.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_koi8-u.ko 2022-03-15T05:38:12.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/nls/nls_utf8.ko 2022-03-15T05:38:12.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2 2022-03-15T05:38:12.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2/cluster 2022-03-15T05:38:12.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2022-03-15T05:38:12.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2/dlm 2022-03-15T05:38:12.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2022-03-15T05:38:12.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2/dlmfs 2022-03-15T05:38:12.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2022-03-15T05:38:12.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2/ocfs2.ko 2022-03-15T05:38:12.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2022-03-15T05:38:12.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2/ocfs2_stack_user.ko 2022-03-15T05:38:12.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ocfs2/ocfs2_stackglue.ko 2022-03-15T05:38:12.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/overlayfs 2022-03-15T05:38:12.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/overlayfs/overlay.ko 2022-03-15T05:38:12.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/pstore 2022-03-15T05:38:12.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/pstore/ramoops.ko 2022-03-15T05:38:12.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/reiserfs 2022-03-15T05:38:12.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/reiserfs/reiserfs.ko 2022-03-15T05:38:12.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/romfs 2022-03-15T05:38:12.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/romfs/romfs.ko 2022-03-15T05:38:12.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/smbfs_common 2022-03-15T05:38:12.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/smbfs_common/cifs_arc4.ko 2022-03-15T05:38:12.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/smbfs_common/cifs_md4.ko 2022-03-15T05:38:12.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/squashfs 2022-03-15T05:38:12.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/squashfs/squashfs.ko 2022-03-15T05:38:12.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/sysv 2022-03-15T05:38:12.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/sysv/sysv.ko 2022-03-15T05:38:12.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/udf 2022-03-15T05:38:12.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/udf/udf.ko 2022-03-15T05:38:12.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ufs 2022-03-15T05:38:12.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/ufs/ufs.ko 2022-03-15T05:38:12.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/xfs 2022-03-15T05:38:12.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/fs/xfs/xfs.ko 2022-03-15T05:38:12.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/kernel 2022-03-15T05:38:12.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/kernel/rcu 2022-03-15T05:38:12.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/kernel/rcu/rcutorture.ko 2022-03-15T05:38:12.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/kernel/torture.ko 2022-03-15T05:38:12.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/kernel/trace 2022-03-15T05:38:12.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/kernel/trace/ring_buffer_benchmark.ko 2022-03-15T05:38:12.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib 2022-03-15T05:38:12.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/asn1_encoder.ko 2022-03-15T05:38:12.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/crc-itu-t.ko 2022-03-15T05:38:12.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/crc64.ko 2022-03-15T05:38:12.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/crc8.ko 2022-03-15T05:38:12.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/crypto 2022-03-15T05:38:12.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/crypto/libarc4.ko 2022-03-15T05:38:12.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/crypto/libdes.ko 2022-03-15T05:38:12.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/libcrc32c.ko 2022-03-15T05:38:12.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/lru_cache.ko 2022-03-15T05:38:12.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/lz4 2022-03-15T05:38:12.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/lz4/lz4_compress.ko 2022-03-15T05:38:12.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/lz4/lz4hc_compress.ko 2022-03-15T05:38:12.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/math 2022-03-15T05:38:12.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/math/cordic.ko 2022-03-15T05:38:12.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/raid6 2022-03-15T05:38:12.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/raid6/raid6_pq.ko 2022-03-15T05:38:12.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/reed_solomon 2022-03-15T05:38:12.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/reed_solomon/reed_solomon.ko 2022-03-15T05:38:12.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/ts_bm.ko 2022-03-15T05:38:12.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/ts_fsm.ko 2022-03-15T05:38:12.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/ts_kmp.ko 2022-03-15T05:38:12.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/zstd 2022-03-15T05:38:12.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/lib/zstd/zstd_compress.ko 2022-03-15T05:38:12.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/mm 2022-03-15T05:38:12.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/mm/hwpoison-inject.ko 2022-03-15T05:38:12.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net 2022-03-15T05:38:12.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/6lowpan 2022-03-15T05:38:12.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/6lowpan/6lowpan.ko 2022-03-15T05:38:12.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/6lowpan/nhc_dest.ko 2022-03-15T05:38:12.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/6lowpan/nhc_fragment.ko 2022-03-15T05:38:12.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/6lowpan/nhc_hop.ko 2022-03-15T05:38:12.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/6lowpan/nhc_ipv6.ko 2022-03-15T05:38:12.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/6lowpan/nhc_mobility.ko 2022-03-15T05:38:12.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/6lowpan/nhc_routing.ko 2022-03-15T05:38:12.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/6lowpan/nhc_udp.ko 2022-03-15T05:38:12.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/802 2022-03-15T05:38:12.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/802/garp.ko 2022-03-15T05:38:12.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/802/mrp.ko 2022-03-15T05:38:12.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/802/p8022.ko 2022-03-15T05:38:12.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/802/psnap.ko 2022-03-15T05:38:12.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/802/stp.ko 2022-03-15T05:38:12.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/8021q 2022-03-15T05:38:12.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/8021q/8021q.ko 2022-03-15T05:38:12.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/9p 2022-03-15T05:38:12.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/9p/9pnet.ko 2022-03-15T05:38:12.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/9p/9pnet_fd.ko 2022-03-15T05:38:12.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/9p/9pnet_rdma.ko 2022-03-15T05:38:12.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/9p/9pnet_virtio.ko 2022-03-15T05:38:12.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/batman-adv 2022-03-15T05:38:12.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/batman-adv/batman-adv.ko 2022-03-15T05:38:12.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge 2022-03-15T05:38:12.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/br_netfilter.ko 2022-03-15T05:38:12.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/bridge.ko 2022-03-15T05:38:12.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter 2022-03-15T05:38:12.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_802_3.ko 2022-03-15T05:38:12.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_among.ko 2022-03-15T05:38:12.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_arp.ko 2022-03-15T05:38:12.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_arpreply.ko 2022-03-15T05:38:12.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_dnat.ko 2022-03-15T05:38:12.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_ip.ko 2022-03-15T05:38:12.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_ip6.ko 2022-03-15T05:38:12.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_limit.ko 2022-03-15T05:38:12.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_log.ko 2022-03-15T05:38:12.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_mark.ko 2022-03-15T05:38:12.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_mark_m.ko 2022-03-15T05:38:12.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_nflog.ko 2022-03-15T05:38:12.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_pkttype.ko 2022-03-15T05:38:12.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_redirect.ko 2022-03-15T05:38:12.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_snat.ko 2022-03-15T05:38:12.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_stp.ko 2022-03-15T05:38:12.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebt_vlan.ko 2022-03-15T05:38:12.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebtable_broute.ko 2022-03-15T05:38:12.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebtable_filter.ko 2022-03-15T05:38:12.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebtable_nat.ko 2022-03-15T05:38:12.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/ebtables.ko 2022-03-15T05:38:12.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2022-03-15T05:38:12.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2022-03-15T05:38:12.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2022-03-15T05:38:12.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ceph 2022-03-15T05:38:12.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ceph/libceph.ko 2022-03-15T05:38:12.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/core 2022-03-15T05:38:12.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/core/failover.ko 2022-03-15T05:38:12.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/core/pktgen.ko 2022-03-15T05:38:12.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dccp 2022-03-15T05:38:12.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dccp/dccp.ko 2022-03-15T05:38:12.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dccp/dccp_diag.ko 2022-03-15T05:38:12.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dccp/dccp_ipv4.ko 2022-03-15T05:38:12.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dccp/dccp_ipv6.ko 2022-03-15T05:38:12.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dns_resolver 2022-03-15T05:38:12.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dns_resolver/dns_resolver.ko 2022-03-15T05:38:12.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dsa 2022-03-15T05:38:12.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dsa/dsa_core.ko 2022-03-15T05:38:12.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dsa/tag_brcm.ko 2022-03-15T05:38:12.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dsa/tag_dsa.ko 2022-03-15T05:38:12.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/dsa/tag_trailer.ko 2022-03-15T05:38:12.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ieee802154 2022-03-15T05:38:12.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ieee802154/6lowpan 2022-03-15T05:38:12.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2022-03-15T05:38:12.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ieee802154/ieee802154.ko 2022-03-15T05:38:12.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ieee802154/ieee802154_socket.ko 2022-03-15T05:38:12.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4 2022-03-15T05:38:12.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/ah4.ko 2022-03-15T05:38:12.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/esp4.ko 2022-03-15T05:38:12.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/fou.ko 2022-03-15T05:38:12.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/gre.ko 2022-03-15T05:38:12.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/inet_diag.ko 2022-03-15T05:38:12.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/ip_gre.ko 2022-03-15T05:38:12.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/ip_tunnel.ko 2022-03-15T05:38:12.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/ip_vti.ko 2022-03-15T05:38:12.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/ipcomp.ko 2022-03-15T05:38:12.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/ipip.ko 2022-03-15T05:38:12.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter 2022-03-15T05:38:12.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/arp_tables.ko 2022-03-15T05:38:12.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/arpt_mangle.ko 2022-03-15T05:38:12.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/arptable_filter.ko 2022-03-15T05:38:12.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/ipt_CLUSTERIP.ko 2022-03-15T05:38:12.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/ipt_ECN.ko 2022-03-15T05:38:12.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2022-03-15T05:38:12.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/ipt_ah.ko 2022-03-15T05:38:12.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2022-03-15T05:38:12.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/iptable_mangle.ko 2022-03-15T05:38:12.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/iptable_nat.ko 2022-03-15T05:38:12.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/iptable_raw.ko 2022-03-15T05:38:12.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/iptable_security.ko 2022-03-15T05:38:12.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2022-03-15T05:38:12.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2022-03-15T05:38:12.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2022-03-15T05:38:12.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2022-03-15T05:38:12.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2022-03-15T05:38:12.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2022-03-15T05:38:12.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2022-03-15T05:38:12.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2022-03-15T05:38:12.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2022-03-15T05:38:12.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2022-03-15T05:38:12.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_bic.ko 2022-03-15T05:38:12.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_dctcp.ko 2022-03-15T05:38:12.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_diag.ko 2022-03-15T05:38:12.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_highspeed.ko 2022-03-15T05:38:12.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_htcp.ko 2022-03-15T05:38:12.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_hybla.ko 2022-03-15T05:38:12.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_illinois.ko 2022-03-15T05:38:12.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_lp.ko 2022-03-15T05:38:12.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_scalable.ko 2022-03-15T05:38:12.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_vegas.ko 2022-03-15T05:38:12.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_veno.ko 2022-03-15T05:38:12.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_westwood.ko 2022-03-15T05:38:12.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tcp_yeah.ko 2022-03-15T05:38:12.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/tunnel4.ko 2022-03-15T05:38:12.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/udp_diag.ko 2022-03-15T05:38:12.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/udp_tunnel.ko 2022-03-15T05:38:12.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv4/xfrm4_tunnel.ko 2022-03-15T05:38:12.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6 2022-03-15T05:38:12.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/ah6.ko 2022-03-15T05:38:12.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/esp6.ko 2022-03-15T05:38:12.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/fou6.ko 2022-03-15T05:38:12.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/ip6_tunnel.ko 2022-03-15T05:38:12.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/ip6_udp_tunnel.ko 2022-03-15T05:38:12.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/ip6_vti.ko 2022-03-15T05:38:12.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/ipcomp6.ko 2022-03-15T05:38:12.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter 2022-03-15T05:38:12.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6_tables.ko 2022-03-15T05:38:12.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2022-03-15T05:38:12.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2022-03-15T05:38:12.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6t_ah.ko 2022-03-15T05:38:12.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2022-03-15T05:38:12.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6t_frag.ko 2022-03-15T05:38:12.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2022-03-15T05:38:12.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2022-03-15T05:38:12.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6t_mh.ko 2022-03-15T05:38:12.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2022-03-15T05:38:12.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6t_rt.ko 2022-03-15T05:38:12.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6table_filter.ko 2022-03-15T05:38:12.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2022-03-15T05:38:12.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6table_nat.ko 2022-03-15T05:38:12.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6table_raw.ko 2022-03-15T05:38:12.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/ip6table_security.ko 2022-03-15T05:38:12.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2022-03-15T05:38:12.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2022-03-15T05:38:12.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2022-03-15T05:38:12.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2022-03-15T05:38:12.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2022-03-15T05:38:12.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2022-03-15T05:38:12.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2022-03-15T05:38:12.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2022-03-15T05:38:12.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/sit.ko 2022-03-15T05:38:12.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/tunnel6.ko 2022-03-15T05:38:12.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/ipv6/xfrm6_tunnel.ko 2022-03-15T05:38:12.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/key 2022-03-15T05:38:12.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/key/af_key.ko 2022-03-15T05:38:12.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/l2tp 2022-03-15T05:38:12.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/l2tp/l2tp_core.ko 2022-03-15T05:38:12.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/l2tp/l2tp_debugfs.ko 2022-03-15T05:38:12.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/l2tp/l2tp_eth.ko 2022-03-15T05:38:12.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/l2tp/l2tp_ip.ko 2022-03-15T05:38:12.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/l2tp/l2tp_ip6.ko 2022-03-15T05:38:12.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/l2tp/l2tp_netlink.ko 2022-03-15T05:38:12.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/l2tp/l2tp_ppp.ko 2022-03-15T05:38:12.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/llc 2022-03-15T05:38:12.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/llc/llc.ko 2022-03-15T05:38:12.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/mac802154 2022-03-15T05:38:12.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/mac802154/mac802154.ko 2022-03-15T05:38:12.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/mpls 2022-03-15T05:38:12.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/mpls/mpls_gso.ko 2022-03-15T05:38:12.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter 2022-03-15T05:38:12.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset 2022-03-15T05:38:12.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set.ko 2022-03-15T05:38:12.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2022-03-15T05:38:12.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2022-03-15T05:38:12.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2022-03-15T05:38:12.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2022-03-15T05:38:12.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2022-03-15T05:38:12.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2022-03-15T05:38:12.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2022-03-15T05:38:12.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2022-03-15T05:38:12.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2022-03-15T05:38:12.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2022-03-15T05:38:12.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2022-03-15T05:38:12.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2022-03-15T05:38:12.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2022-03-15T05:38:12.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2022-03-15T05:38:12.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipset/ip_set_list_set.ko 2022-03-15T05:38:12.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs 2022-03-15T05:38:12.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs.ko 2022-03-15T05:38:12.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2022-03-15T05:38:12.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2022-03-15T05:38:12.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2022-03-15T05:38:12.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2022-03-15T05:38:12.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2022-03-15T05:38:12.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2022-03-15T05:38:12.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2022-03-15T05:38:12.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2022-03-15T05:38:12.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2022-03-15T05:38:12.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2022-03-15T05:38:12.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2022-03-15T05:38:12.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2022-03-15T05:38:12.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2022-03-15T05:38:12.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conncount.ko 2022-03-15T05:38:12.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack.ko 2022-03-15T05:38:12.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_amanda.ko 2022-03-15T05:38:12.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_broadcast.ko 2022-03-15T05:38:12.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_ftp.ko 2022-03-15T05:38:12.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_h323.ko 2022-03-15T05:38:12.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_irc.ko 2022-03-15T05:38:12.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2022-03-15T05:38:12.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_netlink.ko 2022-03-15T05:38:12.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_pptp.ko 2022-03-15T05:38:12.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_sane.ko 2022-03-15T05:38:12.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_sip.ko 2022-03-15T05:38:12.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_snmp.ko 2022-03-15T05:38:12.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_conntrack_tftp.ko 2022-03-15T05:38:12.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_dup_netdev.ko 2022-03-15T05:38:12.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_flow_table.ko 2022-03-15T05:38:12.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_flow_table_inet.ko 2022-03-15T05:38:12.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_log_syslog.ko 2022-03-15T05:38:12.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_nat.ko 2022-03-15T05:38:12.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_nat_amanda.ko 2022-03-15T05:38:12.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_nat_ftp.ko 2022-03-15T05:38:12.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_nat_irc.ko 2022-03-15T05:38:12.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_nat_sip.ko 2022-03-15T05:38:12.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_nat_tftp.ko 2022-03-15T05:38:12.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_synproxy_core.ko 2022-03-15T05:38:12.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nf_tables.ko 2022-03-15T05:38:12.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nfnetlink.ko 2022-03-15T05:38:12.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nfnetlink_acct.ko 2022-03-15T05:38:12.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nfnetlink_log.ko 2022-03-15T05:38:12.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nfnetlink_osf.ko 2022-03-15T05:38:12.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nfnetlink_queue.ko 2022-03-15T05:38:12.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_chain_nat.ko 2022-03-15T05:38:12.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_compat.ko 2022-03-15T05:38:12.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_ct.ko 2022-03-15T05:38:12.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_dup_netdev.ko 2022-03-15T05:38:12.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_fib.ko 2022-03-15T05:38:12.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_fwd_netdev.ko 2022-03-15T05:38:12.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_hash.ko 2022-03-15T05:38:12.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_limit.ko 2022-03-15T05:38:12.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_log.ko 2022-03-15T05:38:12.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_masq.ko 2022-03-15T05:38:12.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_nat.ko 2022-03-15T05:38:12.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_numgen.ko 2022-03-15T05:38:12.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_objref.ko 2022-03-15T05:38:12.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_queue.ko 2022-03-15T05:38:12.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_quota.ko 2022-03-15T05:38:12.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_redir.ko 2022-03-15T05:38:12.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_reject.ko 2022-03-15T05:38:12.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_reject_inet.ko 2022-03-15T05:38:12.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_socket.ko 2022-03-15T05:38:12.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/nft_tunnel.ko 2022-03-15T05:38:12.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_AUDIT.ko 2022-03-15T05:38:12.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_CHECKSUM.ko 2022-03-15T05:38:12.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_CLASSIFY.ko 2022-03-15T05:38:12.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_CONNSECMARK.ko 2022-03-15T05:38:12.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_CT.ko 2022-03-15T05:38:12.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_DSCP.ko 2022-03-15T05:38:12.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_HL.ko 2022-03-15T05:38:12.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_HMARK.ko 2022-03-15T05:38:12.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_IDLETIMER.ko 2022-03-15T05:38:12.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_LED.ko 2022-03-15T05:38:12.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_LOG.ko 2022-03-15T05:38:12.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_MASQUERADE.ko 2022-03-15T05:38:12.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_NETMAP.ko 2022-03-15T05:38:12.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_NFLOG.ko 2022-03-15T05:38:12.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_NFQUEUE.ko 2022-03-15T05:38:12.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_RATEEST.ko 2022-03-15T05:38:12.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_REDIRECT.ko 2022-03-15T05:38:12.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_SECMARK.ko 2022-03-15T05:38:12.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_TCPMSS.ko 2022-03-15T05:38:12.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2022-03-15T05:38:12.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_TEE.ko 2022-03-15T05:38:12.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_TPROXY.ko 2022-03-15T05:38:12.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_TRACE.ko 2022-03-15T05:38:12.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_addrtype.ko 2022-03-15T05:38:12.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_bpf.ko 2022-03-15T05:38:12.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_cgroup.ko 2022-03-15T05:38:12.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_cluster.ko 2022-03-15T05:38:12.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_comment.ko 2022-03-15T05:38:12.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_connbytes.ko 2022-03-15T05:38:12.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_connlabel.ko 2022-03-15T05:38:12.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_connlimit.ko 2022-03-15T05:38:12.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_connmark.ko 2022-03-15T05:38:12.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_conntrack.ko 2022-03-15T05:38:12.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_cpu.ko 2022-03-15T05:38:12.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_dccp.ko 2022-03-15T05:38:12.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_devgroup.ko 2022-03-15T05:38:12.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_dscp.ko 2022-03-15T05:38:12.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_ecn.ko 2022-03-15T05:38:12.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_esp.ko 2022-03-15T05:38:12.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_hashlimit.ko 2022-03-15T05:38:12.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_helper.ko 2022-03-15T05:38:12.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_hl.ko 2022-03-15T05:38:12.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_ipcomp.ko 2022-03-15T05:38:12.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_iprange.ko 2022-03-15T05:38:12.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_ipvs.ko 2022-03-15T05:38:12.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_l2tp.ko 2022-03-15T05:38:12.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_length.ko 2022-03-15T05:38:12.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_limit.ko 2022-03-15T05:38:12.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_mac.ko 2022-03-15T05:38:12.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_mark.ko 2022-03-15T05:38:12.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_multiport.ko 2022-03-15T05:38:12.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_nat.ko 2022-03-15T05:38:12.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_nfacct.ko 2022-03-15T05:38:12.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_osf.ko 2022-03-15T05:38:12.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_owner.ko 2022-03-15T05:38:12.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_physdev.ko 2022-03-15T05:38:12.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_pkttype.ko 2022-03-15T05:38:12.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_policy.ko 2022-03-15T05:38:12.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_quota.ko 2022-03-15T05:38:12.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_rateest.ko 2022-03-15T05:38:12.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_realm.ko 2022-03-15T05:38:12.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_recent.ko 2022-03-15T05:38:12.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_sctp.ko 2022-03-15T05:38:12.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_set.ko 2022-03-15T05:38:12.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_socket.ko 2022-03-15T05:38:12.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_state.ko 2022-03-15T05:38:12.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_statistic.ko 2022-03-15T05:38:12.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_string.ko 2022-03-15T05:38:12.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_tcpmss.ko 2022-03-15T05:38:12.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_time.ko 2022-03-15T05:38:12.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netfilter/xt_u32.ko 2022-03-15T05:38:12.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netlink 2022-03-15T05:38:12.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/netlink/netlink_diag.ko 2022-03-15T05:38:12.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/nsh 2022-03-15T05:38:12.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/nsh/nsh.ko 2022-03-15T05:38:12.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/openvswitch 2022-03-15T05:38:12.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/openvswitch/openvswitch.ko 2022-03-15T05:38:12.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/openvswitch/vport-geneve.ko 2022-03-15T05:38:12.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/openvswitch/vport-gre.ko 2022-03-15T05:38:12.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/openvswitch/vport-vxlan.ko 2022-03-15T05:38:12.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/packet 2022-03-15T05:38:12.420 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/packet/af_packet_diag.ko 2022-03-15T05:38:12.420 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/rds 2022-03-15T05:38:12.420 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/rds/rds.ko 2022-03-15T05:38:12.420 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/rds/rds_rdma.ko 2022-03-15T05:38:12.420 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/rds/rds_tcp.ko 2022-03-15T05:38:12.421 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched 2022-03-15T05:38:12.421 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/act_csum.ko 2022-03-15T05:38:12.421 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/act_gact.ko 2022-03-15T05:38:12.421 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/act_ipt.ko 2022-03-15T05:38:12.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/act_mirred.ko 2022-03-15T05:38:12.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/act_nat.ko 2022-03-15T05:38:12.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/act_pedit.ko 2022-03-15T05:38:12.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/act_police.ko 2022-03-15T05:38:12.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/act_simple.ko 2022-03-15T05:38:12.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/act_skbedit.ko 2022-03-15T05:38:12.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/act_vlan.ko 2022-03-15T05:38:12.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/cls_basic.ko 2022-03-15T05:38:12.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/cls_bpf.ko 2022-03-15T05:38:12.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/cls_flow.ko 2022-03-15T05:38:12.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/cls_fw.ko 2022-03-15T05:38:12.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/cls_route.ko 2022-03-15T05:38:12.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/cls_rsvp.ko 2022-03-15T05:38:12.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/cls_rsvp6.ko 2022-03-15T05:38:12.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/cls_tcindex.ko 2022-03-15T05:38:12.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/cls_u32.ko 2022-03-15T05:38:12.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/em_cmp.ko 2022-03-15T05:38:12.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/em_ipset.ko 2022-03-15T05:38:12.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/em_meta.ko 2022-03-15T05:38:12.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/em_nbyte.ko 2022-03-15T05:38:12.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/em_text.ko 2022-03-15T05:38:12.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/em_u32.ko 2022-03-15T05:38:12.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_cbq.ko 2022-03-15T05:38:12.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_choke.ko 2022-03-15T05:38:12.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_codel.ko 2022-03-15T05:38:12.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_drr.ko 2022-03-15T05:38:12.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_dsmark.ko 2022-03-15T05:38:12.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_fq.ko 2022-03-15T05:38:12.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_gred.ko 2022-03-15T05:38:12.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_hfsc.ko 2022-03-15T05:38:12.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_hhf.ko 2022-03-15T05:38:12.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_htb.ko 2022-03-15T05:38:12.429 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_ingress.ko 2022-03-15T05:38:12.429 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_mqprio.ko 2022-03-15T05:38:12.429 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_multiq.ko 2022-03-15T05:38:12.429 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_netem.ko 2022-03-15T05:38:12.429 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_pie.ko 2022-03-15T05:38:12.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_plug.ko 2022-03-15T05:38:12.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_prio.ko 2022-03-15T05:38:12.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_qfq.ko 2022-03-15T05:38:12.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_red.ko 2022-03-15T05:38:12.431 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_sfb.ko 2022-03-15T05:38:12.431 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_sfq.ko 2022-03-15T05:38:12.431 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_tbf.ko 2022-03-15T05:38:12.431 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sched/sch_teql.ko 2022-03-15T05:38:12.432 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sctp 2022-03-15T05:38:12.432 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sctp/sctp.ko 2022-03-15T05:38:12.432 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sctp/sctp_diag.ko 2022-03-15T05:38:12.432 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sunrpc 2022-03-15T05:38:12.432 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sunrpc/auth_gss 2022-03-15T05:38:12.433 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2022-03-15T05:38:12.433 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2022-03-15T05:38:12.433 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sunrpc/sunrpc.ko 2022-03-15T05:38:12.433 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sunrpc/xprtrdma 2022-03-15T05:38:12.434 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2022-03-15T05:38:12.434 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/tipc 2022-03-15T05:38:12.434 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/tipc/diag.ko 2022-03-15T05:38:12.434 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/tipc/tipc.ko 2022-03-15T05:38:12.434 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/unix 2022-03-15T05:38:12.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/unix/unix_diag.ko 2022-03-15T05:38:12.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/vmw_vsock 2022-03-15T05:38:12.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2022-03-15T05:38:12.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2022-03-15T05:38:12.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/vmw_vsock/vsock.ko 2022-03-15T05:38:12.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/vmw_vsock/vsock_diag.ko 2022-03-15T05:38:12.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/vmw_vsock/vsock_loopback.ko 2022-03-15T05:38:12.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/xfrm 2022-03-15T05:38:12.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/net/xfrm/xfrm_ipcomp.ko 2022-03-15T05:38:12.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/security 2022-03-15T05:38:12.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/security/keys 2022-03-15T05:38:12.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/security/keys/encrypted-keys 2022-03-15T05:38:12.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2022-03-15T05:38:12.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/security/keys/trusted-keys 2022-03-15T05:38:12.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/security/keys/trusted-keys/trusted.ko 2022-03-15T05:38:12.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/virt 2022-03-15T05:38:12.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/virt/lib 2022-03-15T05:38:12.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/kernel/virt/lib/irqbypass.ko 2022-03-15T05:38:12.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.alias 2022-03-15T05:38:12.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.alias.bin 2022-03-15T05:38:12.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.builtin 2022-03-15T05:38:12.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.builtin.bin 2022-03-15T05:38:12.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.builtin.modinfo 2022-03-15T05:38:12.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.dep 2022-03-15T05:38:12.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.dep.bin 2022-03-15T05:38:12.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.devname 2022-03-15T05:38:12.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.order 2022-03-15T05:38:12.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.softdep 2022-03-15T05:38:12.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.symbols 2022-03-15T05:38:12.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/5.17.0-rc6-ceph-ga020a702a220/modules.symbols.bin 2022-03-15T05:38:12.441 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/lib/.build-id 2022-03-15T05:38:12.442 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/lib/.build-id/61 2022-03-15T05:38:12.442 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/lib/.build-id/61/b57873d11db5b5a491bb911fb16e0bc4895875 2022-03-15T05:38:12.443 DEBUG:teuthology.task.kernel:get_image_version: 5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:38:12.443 DEBUG:teuthology.orchestra.run.smithi151:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2022-03-15T05:38:12.471 INFO:teuthology.orchestra.run.smithi151.stdout:postinstall scriptlet (using /bin/sh): 2022-03-15T05:38:12.471 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-5.17.0-rc6-ceph-ga020a702a220 -a -r /boot/System.map-5.17.0-rc6-ceph-ga020a702a220 ]; then 2022-03-15T05:38:12.471 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/vmlinuz-5.17.0-rc6-ceph-ga020a702a220 /boot/.vmlinuz-5.17.0-rc6-ceph-ga020a702a220-rpm 2022-03-15T05:38:12.472 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/System.map-5.17.0-rc6-ceph-ga020a702a220 /boot/.System.map-5.17.0-rc6-ceph-ga020a702a220-rpm 2022-03-15T05:38:12.472 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/vmlinuz-5.17.0-rc6-ceph-ga020a702a220 /boot/System.map-5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:38:12.472 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/installkernel 5.17.0-rc6-ceph-ga020a702a220 /boot/.vmlinuz-5.17.0-rc6-ceph-ga020a702a220-rpm /boot/.System.map-5.17.0-rc6-ceph-ga020a702a220-rpm 2022-03-15T05:38:12.472 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/.vmlinuz-5.17.0-rc6-ceph-ga020a702a220-rpm /boot/.System.map-5.17.0-rc6-ceph-ga020a702a220-rpm 2022-03-15T05:38:12.473 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2022-03-15T05:38:12.473 INFO:teuthology.orchestra.run.smithi151.stdout:preuninstall scriptlet (using /bin/sh): 2022-03-15T05:38:12.473 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2022-03-15T05:38:12.473 INFO:teuthology.orchestra.run.smithi151.stdout:new-kernel-pkg --remove 5.17.0-rc6-ceph-ga020a702a220 --rminitrd --initrdfile=/boot/initramfs-5.17.0-rc6-ceph-ga020a702a220.img 2022-03-15T05:38:12.473 INFO:teuthology.orchestra.run.smithi151.stdout:elif [ -x /usr/bin/kernel-install ]; then 2022-03-15T05:38:12.474 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-install remove 5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:38:12.474 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2022-03-15T05:38:12.474 INFO:teuthology.orchestra.run.smithi151.stdout:postuninstall scriptlet (using /bin/sh): 2022-03-15T05:38:12.474 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/update-bootloader ]; then 2022-03-15T05:38:12.474 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/update-bootloader --remove 5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:38:12.475 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2022-03-15T05:38:12.476 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2022-03-15T05:38:12.554 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2022-03-15T05:38:12.554 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2022-03-15T05:38:12.554 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.02 2022-03-15T05:38:12.555 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 106.el8 2022-03-15T05:38:12.555 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2022-03-15T05:38:12.555 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Fri 04 Feb 2022 04:06:37 PM UTC 2022-03-15T05:38:12.555 INFO:teuthology.orchestra.run.smithi151.stdout:Group : System Environment/Base 2022-03-15T05:38:12.556 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 9265339 2022-03-15T05:38:12.556 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2022-03-15T05:38:12.556 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Mon 08 Nov 2021 06:49:52 AM UTC, Key ID 05b555b38483c65d 2022-03-15T05:38:12.556 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.02-106.el8.src.rpm 2022-03-15T05:38:12.556 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Mon 08 Nov 2021 06:39:57 AM UTC 2022-03-15T05:38:12.557 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : kbuilder.bsys.centos.org 2022-03-15T05:38:12.557 INFO:teuthology.orchestra.run.smithi151.stdout:Relocations : (not relocatable) 2022-03-15T05:38:12.557 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : CentOS BuildSystem 2022-03-15T05:38:12.557 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : CentOS 2022-03-15T05:38:12.558 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2022-03-15T05:38:12.558 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2022-03-15T05:38:12.558 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2022-03-15T05:38:12.558 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:38:12.558 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-03-15T05:38:12.559 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2022-03-15T05:38:12.559 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2022-03-15T05:38:12.559 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2022-03-15T05:38:12.559 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:38:12.560 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2022-03-15T05:38:12.561 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-03-15T05:38:12.561 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:38:12.561 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-03-15T05:38:15.739 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2022-03-15T05:38:17.856 INFO:teuthology.orchestra.run.smithi151.stderr:done 2022-03-15T05:38:17.859 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2022-03-15T05:38:17.880 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.wVWPbKrnNG 2022-03-15T05:38:17.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wVWPbKrnNG 2022-03-15T05:38:17.952 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.wVWPbKrnNG 2022-03-15T05:38:18.107 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.wVWPbKrnNG is 6KB 2022-03-15T05:38:18.158 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.wVWPbKrnNG 2022-03-15T05:38:18.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2022-03-15T05:38:18.253 INFO:teuthology.orchestra.run.smithi151.stdout:de9f16d36b2643dd85552c363843f45b-0-rescue.conf 2022-03-15T05:38:18.254 INFO:teuthology.orchestra.run.smithi151.stdout:de9f16d36b2643dd85552c363843f45b-4.18.0-305.3.1.el8.x86_64.conf 2022-03-15T05:38:18.254 INFO:teuthology.orchestra.run.smithi151.stdout:de9f16d36b2643dd85552c363843f45b-4.18.0-358.el8.x86_64.conf 2022-03-15T05:38:18.255 INFO:teuthology.orchestra.run.smithi151.stdout:de9f16d36b2643dd85552c363843f45b-5.17.0-rc6-ceph-ga020a702a220.conf 2022-03-15T05:38:18.256 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default de9f16d36b2643dd85552c363843f45b-5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:38:18.401 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2022-03-15T05:38:48.404 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2022-03-15T05:38:48.405 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2022-03-15T05:38:48.406 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-15T05:39:22.959 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2022-03-15T05:39:52.961 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2022-03-15T05:39:52.962 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-15T05:40:10.520 DEBUG:teuthology.orchestra.run.smithi151:> true 2022-03-15T05:40:10.930 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2022-03-15T05:40:10.930 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.17.0-rc6-ceph-ga020a702a220"... 2022-03-15T05:40:10.931 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2022-03-15T05:40:10.983 INFO:teuthology.orchestra.run.smithi151.stdout:5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:40:10.984 DEBUG:teuthology.task.kernel:current kernel version is 5.17.0-rc6-ceph-ga020a702a220 vs 5.17.0-rc6-ceph-ga020a702a220 2022-03-15T05:40:10.984 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-03-15T05:40:10.984 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-03-15T05:40:11.987 DEBUG:teuthology.parallel:result is None 2022-03-15T05:40:11.988 INFO:teuthology.run_tasks:Running task internal.base... 2022-03-15T05:40:12.001 INFO:teuthology.task.internal:Creating test directory... 2022-03-15T05:40:12.002 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-03-15T05:40:12.007 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-03-15T05:40:12.060 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-03-15T05:40:12.071 INFO:teuthology.run_tasks:Running task internal.archive... 2022-03-15T05:40:12.098 INFO:teuthology.task.internal:Creating archive directory... 2022-03-15T05:40:12.099 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-03-15T05:40:12.104 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-03-15T05:40:12.176 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-03-15T05:40:12.186 INFO:teuthology.task.internal:Enabling coredump saving... 2022-03-15T05:40:12.187 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-03-15T05:40:12.192 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-03-15T05:40:12.254 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-15T05:40:12.274 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-15T05:40:12.356 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-15T05:40:12.392 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-15T05:40:12.397 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-03-15T05:40:12.405 INFO:teuthology.task.internal:Configuring sudo... 2022-03-15T05:40:12.406 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-03-15T05:40:12.411 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-03-15T05:40:12.487 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-03-15T05:40:12.500 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-03-15T05:40:12.501 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-03-15T05:40:12.505 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-03-15T05:40:12.553 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-15T05:40:12.636 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-15T05:40:12.724 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-15T05:40:12.806 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-15T05:40:12.885 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:40:12.885 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-03-15T05:40:12.973 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-15T05:40:13.018 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-15T05:40:13.078 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-15T05:40:13.163 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-15T05:40:13.209 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:40:13.209 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-03-15T05:40:13.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2022-03-15T05:40:13.283 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2022-03-15T05:40:13.394 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-03-15T05:40:13.412 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-03-15T05:40:13.658 INFO:teuthology.run_tasks:Running task internal.timer... 2022-03-15T05:40:13.675 INFO:teuthology.task.internal:Starting timer... 2022-03-15T05:40:13.675 INFO:teuthology.run_tasks:Running task pcp... 2022-03-15T05:40:13.719 INFO:teuthology.run_tasks:Running task selinux... 2022-03-15T05:40:13.751 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-03-15T05:40:13.751 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2022-03-15T05:40:13.877 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2022-03-15T05:40:13.882 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2022-03-15T05:40:13.944 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2022-03-15T05:40:13.945 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-03-15T05:40:13.945 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2022-03-15T05:40:14.002 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2022-03-15T05:40:14.004 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2022-03-15T05:40:14.025 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2022-03-15T05:40:14.025 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi151.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi164.front.sepia.ceph.com': 'permissive'} 2022-03-15T05:40:14.026 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-03-15T05:40:14.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-03-15T05:40:14.107 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-03-15T05:40:14.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-03-15T05:40:14.136 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-03-15T05:40:14.136 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2022-03-15T05:40:14.242 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2022-03-15T05:40:14.271 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-03-15T05:40:14.285 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2022-03-15T05:40:14.285 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-03-15T05:40:14.310 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-03-15T05:40:14.311 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi151.front.sepia.ceph.com,smithi164.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2022-03-15T05:46:35.413 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi151.front.sepia.ceph.com'), Remote(name='ubuntu@smithi164.front.sepia.ceph.com')] 2022-03-15T05:46:35.415 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2022-03-15T05:46:35.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-15T05:46:35.511 DEBUG:teuthology.orchestra.run.smithi151:> true 2022-03-15T05:46:35.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2022-03-15T05:46:35.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-15T05:46:35.693 DEBUG:teuthology.orchestra.run.smithi164:> true 2022-03-15T05:46:35.761 INFO:teuthology.run_tasks:Running task clock... 2022-03-15T05:46:35.776 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-03-15T05:46:35.777 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-03-15T05:46:35.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-03-15T05:46:35.784 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-03-15T05:46:35.784 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-03-15T05:46:35.835 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-03-15T05:46:35.850 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-03-15T05:46:35.864 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-03-15T05:46:35.901 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-03-15T05:46:35.931 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2022-03-15T05:46:35.943 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2022-03-15T05:46:35.958 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-03-15T05:46:35.972 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-03-15T05:46:35.994 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2022-03-15T05:46:36.025 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2022-03-15T05:46:36.040 INFO:teuthology.orchestra.run.smithi164.stderr:bash: ntpq: command not found 2022-03-15T05:46:36.043 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-03-15T05:46:36.043 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2022-03-15T05:46:36.044 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-15T05:46:36.044 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-15T05:46:36.044 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-15T05:46:36.044 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-15T05:46:36.061 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-03-15T05:46:36.099 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-03-15T05:46:36.192 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2022-03-15T05:46:36.200 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-03-15T05:46:36.200 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2022-03-15T05:46:36.200 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-15T05:46:36.201 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-15T05:46:36.201 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-15T05:46:36.201 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-15T05:46:36.202 INFO:teuthology.run_tasks:Running task install... 2022-03-15T05:46:36.215 DEBUG:teuthology.task.install:project ceph 2022-03-15T05:46:36.215 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1f661216557ac5e13e140eb1700d0e5a15dd3b4c'}} 2022-03-15T05:46:36.216 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '1f661216557ac5e13e140eb1700d0e5a15dd3b4c'} 2022-03-15T05:46:36.216 INFO:teuthology.task.install:Using flavor: default 2022-03-15T05:46:36.226 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2022-03-15T05:46:36.227 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2022-03-15T05:46:36.227 DEBUG:teuthology.orchestra.run.smithi151:> sudo lsb_release -is 2022-03-15T05:46:36.337 INFO:teuthology.orchestra.run.smithi151.stdout:CentOSStream 2022-03-15T05:46:36.341 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-03-15T05:46:36.341 DEBUG:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2022-03-15T05:46:36.342 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1f661216557ac5e13e140eb1700d0e5a15dd3b4c', 'tag': None, 'wait_for_package': False} 2022-03-15T05:46:36.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo lsb_release -is 2022-03-15T05:46:36.380 INFO:teuthology.orchestra.run.smithi164.stdout:CentOSStream 2022-03-15T05:46:36.382 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-03-15T05:46:36.383 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1f661216557ac5e13e140eb1700d0e5a15dd3b4c', 'tag': None, 'wait_for_package': False} 2022-03-15T05:46:36.384 DEBUG:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2022-03-15T05:46:36.452 INFO:teuthology.orchestra.run.smithi151.stdout:CentOSStream 2022-03-15T05:46:36.456 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-03-15T05:46:36.457 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1f661216557ac5e13e140eb1700d0e5a15dd3b4c 2022-03-15T05:46:36.462 INFO:teuthology.orchestra.run.smithi164.stdout:CentOSStream 2022-03-15T05:46:36.463 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-03-15T05:46:36.463 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1f661216557ac5e13e140eb1700d0e5a15dd3b4c 2022-03-15T05:46:36.757 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220314-103400/1f661216557ac5e13e140eb1700d0e5a15dd3b4c/centos/8/flavors/default/ 2022-03-15T05:46:36.758 INFO:teuthology.task.install.rpm:Package version is 17.0.0-11109.g1f661216 2022-03-15T05:46:36.775 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220314-103400/1f661216557ac5e13e140eb1700d0e5a15dd3b4c/centos/8/flavors/default/ 2022-03-15T05:46:36.775 INFO:teuthology.task.install.rpm:Package version is 17.0.0-11109.g1f661216 2022-03-15T05:46:36.904 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220314-103400/1f661216557ac5e13e140eb1700d0e5a15dd3b4c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220314-103400/1f661216557ac5e13e140eb1700d0e5a15dd3b4c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220314-103400/1f661216557ac5e13e140eb1700d0e5a15dd3b4c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-03-15T05:46:36.905 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:46:36.906 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-03-15T05:46:36.921 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220314-103400/1f661216557ac5e13e140eb1700d0e5a15dd3b4c/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220314-103400/1f661216557ac5e13e140eb1700d0e5a15dd3b4c/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-20220314-103400/1f661216557ac5e13e140eb1700d0e5a15dd3b4c/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2022-03-15T05:46:36.921 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:46:36.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2022-03-15T05:46:36.933 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-03-15T05:46:36.934 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1f661216557ac5e13e140eb1700d0e5a15dd3b4c/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-03-15T05:46:37.001 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-03-15T05:46:37.003 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2022-03-15T05:46:37.003 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1f661216557ac5e13e140eb1700d0e5a15dd3b4c/;g' /etc/yum.repos.d/ceph.repo ; fi 2022-03-15T05:46:37.079 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-03-15T05:46:37.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2022-03-15T05:46:37.144 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2022-03-15T05:46:37.146 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2022-03-15T05:46:37.195 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2022-03-15T05:46:37.273 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2022-03-15T05:46:37.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2022-03-15T05:46:37.363 INFO:teuthology.orchestra.run.smithi164.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-15T05:46:37.364 INFO:teuthology.orchestra.run.smithi164.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-15T05:46:37.384 INFO:teuthology.orchestra.run.smithi164.stdout:61 files removed 2022-03-15T05:46:37.404 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-03-15T05:46:37.553 INFO:teuthology.orchestra.run.smithi151.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-15T05:46:37.554 INFO:teuthology.orchestra.run.smithi151.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-15T05:46:37.580 INFO:teuthology.orchestra.run.smithi164.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-15T05:46:37.580 INFO:teuthology.orchestra.run.smithi164.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-15T05:46:37.593 INFO:teuthology.orchestra.run.smithi151.stdout:61 files removed 2022-03-15T05:46:37.625 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2022-03-15T05:46:37.899 INFO:teuthology.orchestra.run.smithi151.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-15T05:46:37.899 INFO:teuthology.orchestra.run.smithi151.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-15T05:46:38.023 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 258 kB/s | 75 kB 00:00 2022-03-15T05:46:38.324 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 34 kB/s | 9.1 kB 00:00 2022-03-15T05:46:38.439 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 250 kB/s | 75 kB 00:00 2022-03-15T05:46:38.591 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 5.8 kB/s | 1.4 kB 00:00 2022-03-15T05:46:38.732 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 36 kB/s | 9.1 kB 00:00 2022-03-15T05:46:39.017 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 5.5 kB/s | 1.4 kB 00:00 2022-03-15T05:46:39.160 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - AppStream 37 MB/s | 20 MB 00:00 2022-03-15T05:46:39.636 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-8 - AppStream 34 MB/s | 20 MB 00:00 2022-03-15T05:46:43.299 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - Base 37 MB/s | 19 MB 00:00 2022-03-15T05:46:44.045 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-8 - Base 35 MB/s | 19 MB 00:00 2022-03-15T05:46:46.218 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - Extras 158 kB/s | 18 kB 00:00 2022-03-15T05:46:46.595 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-8 - PowerTools 16 MB/s | 4.2 MB 00:00 2022-03-15T05:46:47.136 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-8 - Extras 144 kB/s | 18 kB 00:00 2022-03-15T05:46:47.538 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-8 - PowerTools 15 MB/s | 4.2 MB 00:00 2022-03-15T05:46:49.819 INFO:teuthology.orchestra.run.smithi164.stdout:Copr repo for python3-asyncssh owned by ceph 1.4 kB/s | 3.5 kB 00:02 2022-03-15T05:46:50.730 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 1.5 kB/s | 3.5 kB 00:02 2022-03-15T05:46:51.403 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 11 MB 00:01 2022-03-15T05:46:52.530 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 6.8 MB/s | 11 MB 00:01 2022-03-15T05:46:54.070 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 441 kB/s | 24 kB 00:00 2022-03-15T05:46:55.781 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 393 kB/s | 24 kB 00:00 2022-03-15T05:46:56.592 INFO:teuthology.orchestra.run.smithi164.stdout:Package NetworkManager-1:1.36.0-0.4.el8.x86_64 is already installed. 2022-03-15T05:46:56.593 INFO:teuthology.orchestra.run.smithi164.stdout:Package iproute-5.15.0-2.el8.x86_64 is already installed. 2022-03-15T05:46:56.594 INFO:teuthology.orchestra.run.smithi164.stdout:Package util-linux-2.32.1-32.el8.x86_64 is already installed. 2022-03-15T05:46:56.594 INFO:teuthology.orchestra.run.smithi164.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-03-15T05:46:56.596 INFO:teuthology.orchestra.run.smithi164.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-03-15T05:46:56.598 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-03-15T05:46:56.598 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-03-15T05:46:56.670 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2022-03-15T05:46:56.682 INFO:teuthology.orchestra.run.smithi164.stdout:========================================================================================================= 2022-03-15T05:46:56.683 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2022-03-15T05:46:56.683 INFO:teuthology.orchestra.run.smithi164.stdout:========================================================================================================= 2022-03-15T05:46:56.683 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2022-03-15T05:46:56.683 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-2.el8 CentOS-Base 137 k 2022-03-15T05:46:56.684 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-03-15T05:46:56.684 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:17.0.0-11109.g1f661216.el8 ceph 6.5 k 2022-03-15T05:46:56.684 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:17.0.0-11109.g1f661216.el8 ceph 5.3 M 2022-03-15T05:46:56.684 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:17.0.0-11109.g1f661216.el8 ceph 880 k 2022-03-15T05:46:56.685 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-11109.g1f661216.el8 ceph 169 k 2022-03-15T05:46:56.685 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:17.0.0-11109.g1f661216.el8 ceph 1.5 M 2022-03-15T05:46:56.685 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 103 k 2022-03-15T05:46:56.685 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 1.6 M 2022-03-15T05:46:56.686 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 7.4 M 2022-03-15T05:46:56.686 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 47 k 2022-03-15T05:46:56.686 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:17.0.0-11109.g1f661216.el8 ceph 9.3 M 2022-03-15T05:46:56.686 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:17.0.0-11109.g1f661216.el8 ceph 45 M 2022-03-15T05:46:56.687 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 257 k 2022-03-15T05:46:56.687 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 71 k 2022-03-15T05:46:56.687 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror x86_64 2:17.0.0-11109.g1f661216.el8 ceph 272 k 2022-03-15T05:46:56.687 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 14 k 2022-03-15T05:46:56.688 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 CentOS-Base 60 k 2022-03-15T05:46:56.688 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-03-15T05:46:56.688 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-Base 19 k 2022-03-15T05:46:56.688 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:17.0.0-11109.g1f661216.el8 ceph 25 k 2022-03-15T05:46:56.689 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:17.0.0-11109.g1f661216.el8 ceph 794 k 2022-03-15T05:46:56.689 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:17.0.0-11109.g1f661216.el8 ceph 125 k 2022-03-15T05:46:56.689 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:17.0.0-11109.g1f661216.el8 ceph 3.4 M 2022-03-15T05:46:56.689 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:17.0.0-11109.g1f661216.el8 ceph 3.9 M 2022-03-15T05:46:56.690 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-03-15T05:46:56.690 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.32.1-34.el8 CentOS-Base 98 k 2022-03-15T05:46:56.690 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:1.1.1k-5.el8_5 CentOS-Base 2.3 M 2022-03-15T05:46:56.690 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:17.0.0-11109.g1f661216.el8 ceph 179 k 2022-03-15T05:46:56.691 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:17.0.0-11109.g1f661216.el8 ceph 366 k 2022-03-15T05:46:56.691 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:17.0.0-11109.g1f661216.el8 ceph 345 k 2022-03-15T05:46:56.691 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:17.0.0-11109.g1f661216.el8 ceph 109 k 2022-03-15T05:46:56.691 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:17.0.0-11109.g1f661216.el8 ceph 93 k 2022-03-15T05:46:56.692 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:17.0.0-11109.g1f661216.el8 ceph 3.8 M 2022-03-15T05:46:56.692 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:17.0.0-11109.g1f661216.el8 ceph 175 k 2022-03-15T05:46:56.692 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-Base 72 k 2022-03-15T05:46:56.692 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2022-03-15T05:46:56.692 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager x86_64 1:1.36.0-2.el8 CentOS-Base 2.3 M 2022-03-15T05:46:56.693 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm x86_64 1:1.36.0-2.el8 CentOS-Base 1.8 M 2022-03-15T05:46:56.693 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team x86_64 1:1.36.0-2.el8 CentOS-Base 152 k 2022-03-15T05:46:56.693 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui x86_64 1:1.36.0-2.el8 CentOS-Base 345 k 2022-03-15T05:46:56.693 INFO:teuthology.orchestra.run.smithi164.stdout: iproute x86_64 5.15.0-3.el8 CentOS-Base 796 k 2022-03-15T05:46:56.694 INFO:teuthology.orchestra.run.smithi164.stdout: libblkid x86_64 2.32.1-34.el8 CentOS-Base 218 k 2022-03-15T05:46:56.694 INFO:teuthology.orchestra.run.smithi164.stdout: libfdisk x86_64 2.32.1-34.el8 CentOS-Base 252 k 2022-03-15T05:46:56.694 INFO:teuthology.orchestra.run.smithi164.stdout: libmount x86_64 2.32.1-34.el8 CentOS-Base 235 k 2022-03-15T05:46:56.694 INFO:teuthology.orchestra.run.smithi164.stdout: libsmartcols x86_64 2.32.1-34.el8 CentOS-Base 178 k 2022-03-15T05:46:56.695 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid x86_64 2.32.1-34.el8 CentOS-Base 97 k 2022-03-15T05:46:56.695 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux x86_64 2.32.1-34.el8 CentOS-Base 2.5 M 2022-03-15T05:46:56.695 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-user x86_64 2.32.1-34.el8 CentOS-Base 101 k 2022-03-15T05:46:56.695 INFO:teuthology.orchestra.run.smithi164.stdout: xfsdump x86_64 3.1.8-4.el8 CentOS-Base 332 k 2022-03-15T05:46:56.696 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2022-03-15T05:46:56.696 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-03-15T05:46:56.696 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:17.0.0-11109.g1f661216.el8 ceph 20 M 2022-03-15T05:46:56.696 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 23 k 2022-03-15T05:46:56.697 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:17.0.0-11109.g1f661216.el8 ceph 2.3 M 2022-03-15T05:46:56.697 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 226 k 2022-03-15T05:46:56.697 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:17.0.0-11109.g1f661216.el8 ceph 3.9 M 2022-03-15T05:46:56.697 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:17.0.0-11109.g1f661216.el8 ceph 17 M 2022-03-15T05:46:56.698 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 15 k 2022-03-15T05:46:56.698 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:17.0.0-11109.g1f661216.el8 ceph 24 k 2022-03-15T05:46:56.698 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2022-03-15T05:46:56.698 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-03-15T05:46:56.699 INFO:teuthology.orchestra.run.smithi164.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-03-15T05:46:56.699 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-Base 48 k 2022-03-15T05:46:56.699 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-devel x86_64 1.18.2-14.el8 CentOS-Base 560 k 2022-03-15T05:46:56.699 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:17.0.0-11109.g1f661216.el8 ceph 170 k 2022-03-15T05:46:56.700 INFO:teuthology.orchestra.run.smithi164.stdout: libcom_err-devel x86_64 1.45.6-2.el8 CentOS-Base 38 k 2022-03-15T05:46:56.700 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 8.5.0-10.el8 CentOS-Base 643 k 2022-03-15T05:46:56.700 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-03-15T05:46:56.700 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 8.5.0-10.el8 CentOS-Base 171 k 2022-03-15T05:46:56.701 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-03-15T05:46:56.701 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:17.0.0-11109.g1f661216.el8 ceph 483 k 2022-03-15T05:46:56.701 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-03-15T05:46:56.701 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:17.0.0-11109.g1f661216.el8 ceph 4.0 M 2022-03-15T05:46:56.702 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-devel x86_64 2.9-5.el8 CentOS-Base 200 k 2022-03-15T05:46:56.702 INFO:teuthology.orchestra.run.smithi164.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-Base 87 k 2022-03-15T05:46:56.702 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-03-15T05:46:56.702 INFO:teuthology.orchestra.run.smithi164.stdout: libverto-devel x86_64 0.3.0-5.el8 CentOS-Base 18 k 2022-03-15T05:46:56.703 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-03-15T05:46:56.703 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-03-15T05:46:56.703 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.15-3.el8 CentOS-AppStream 4.7 M 2022-03-15T05:46:56.704 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-threads x86_64 0.3.15-3.el8 CentOS-AppStream 4.9 M 2022-03-15T05:46:56.704 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-devel x86_64 10.32-2.el8 CentOS-Base 605 k 2022-03-15T05:46:56.705 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf16 x86_64 10.32-2.el8 CentOS-Base 229 k 2022-03-15T05:46:56.705 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf32 x86_64 10.32-2.el8 CentOS-Base 220 k 2022-03-15T05:46:56.706 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-03-15T05:46:56.706 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-03-15T05:46:56.707 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-03-15T05:46:56.707 INFO:teuthology.orchestra.run.smithi164.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-03-15T05:46:56.707 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-03-15T05:46:56.708 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:17.0.0-11109.g1f661216.el8 ceph 45 k 2022-03-15T05:46:56.708 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:17.0.0-11109.g1f661216.el8 ceph 104 k 2022-03-15T05:46:56.709 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-03-15T05:46:56.709 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-03-15T05:46:56.709 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-03-15T05:46:56.710 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-03-15T05:46:56.710 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-03-15T05:46:56.711 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-03-15T05:46:56.711 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-03-15T05:46:56.711 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-03-15T05:46:56.712 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-03-15T05:46:56.712 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-03-15T05:46:56.713 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-03-15T05:46:56.713 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-03-15T05:46:56.713 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-03-15T05:46:56.714 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-03-15T05:46:56.714 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-03-15T05:46:56.715 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-03-15T05:46:56.715 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-03-15T05:46:56.715 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-03-15T05:46:56.715 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-03-15T05:46:56.716 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-03-15T05:46:56.716 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-03-15T05:46:56.716 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-03-15T05:46:56.716 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-03-15T05:46:56.717 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-03-15T05:46:56.717 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-03-15T05:46:56.717 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-03-15T05:46:56.717 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-03-15T05:46:56.718 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-03-15T05:46:56.718 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-03-15T05:46:56.718 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-03-15T05:46:56.718 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-03-15T05:46:56.719 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-03-15T05:46:56.719 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-03-15T05:46:56.719 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-03-15T05:46:56.719 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-03-15T05:46:56.720 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-03-15T05:46:56.720 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-03-15T05:46:56.720 INFO:teuthology.orchestra.run.smithi164.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-03-15T05:46:56.720 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-03-15T05:46:56.721 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-03-15T05:46:56.721 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-03-15T05:46:56.721 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-03-15T05:46:56.721 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-03-15T05:46:56.722 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-03-15T05:46:56.722 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-03-15T05:46:56.722 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-03-15T05:46:56.722 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-17.el8 CentOS-Base 58 k 2022-03-15T05:46:56.723 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:46:56.723 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2022-03-15T05:46:56.724 INFO:teuthology.orchestra.run.smithi164.stdout:========================================================================================================= 2022-03-15T05:46:56.724 INFO:teuthology.orchestra.run.smithi164.stdout:Install 124 Packages 2022-03-15T05:46:56.725 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 13 Packages 2022-03-15T05:46:56.725 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:46:56.727 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 191 M 2022-03-15T05:46:56.727 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2022-03-15T05:46:56.838 INFO:teuthology.orchestra.run.smithi164.stdout:(1/137): ceph-17.0.0-11109.g1f661216.el8.x86_64 47 kB/s | 6.5 kB 00:00 2022-03-15T05:46:57.105 INFO:teuthology.orchestra.run.smithi164.stdout:(2/137): ceph-fuse-17.0.0-11109.g1f661216.el8.x 3.2 MB/s | 880 kB 00:00 2022-03-15T05:46:57.164 INFO:teuthology.orchestra.run.smithi164.stdout:(3/137): ceph-immutable-object-cache-17.0.0-111 2.8 MB/s | 169 kB 00:00 2022-03-15T05:46:57.497 INFO:teuthology.orchestra.run.smithi164.stdout:(4/137): ceph-base-17.0.0-11109.g1f661216.el8.x 6.6 MB/s | 5.3 MB 00:00 2022-03-15T05:46:57.556 INFO:teuthology.orchestra.run.smithi164.stdout:(5/137): ceph-mds-17.0.0-11109.g1f661216.el8.x8 5.9 MB/s | 2.3 MB 00:00 2022-03-15T05:46:57.723 INFO:teuthology.orchestra.run.smithi164.stdout:(6/137): ceph-mgr-17.0.0-11109.g1f661216.el8.x8 6.8 MB/s | 1.5 MB 00:00 2022-03-15T05:46:58.140 INFO:teuthology.orchestra.run.smithi164.stdout:(7/137): ceph-mon-17.0.0-11109.g1f661216.el8.x8 6.6 MB/s | 3.9 MB 00:00 2022-03-15T05:46:58.507 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.36.0-0.4.el8.x86_64 is already installed. 2022-03-15T05:46:58.507 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-5.15.0-2.el8.x86_64 is already installed. 2022-03-15T05:46:58.508 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.32.1-32.el8.x86_64 is already installed. 2022-03-15T05:46:58.509 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2022-03-15T05:46:58.510 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2022-03-15T05:46:58.512 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2022-03-15T05:46:58.513 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2022-03-15T05:46:58.591 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2022-03-15T05:46:58.604 INFO:teuthology.orchestra.run.smithi151.stdout:========================================================================================================= 2022-03-15T05:46:58.604 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2022-03-15T05:46:58.605 INFO:teuthology.orchestra.run.smithi151.stdout:========================================================================================================= 2022-03-15T05:46:58.605 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2022-03-15T05:46:58.605 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-2.el8 CentOS-Base 137 k 2022-03-15T05:46:58.605 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.0.4-10.el8 CentOS-AppStream 688 k 2022-03-15T05:46:58.606 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:17.0.0-11109.g1f661216.el8 ceph 6.5 k 2022-03-15T05:46:58.606 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:17.0.0-11109.g1f661216.el8 ceph 5.3 M 2022-03-15T05:46:58.606 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:17.0.0-11109.g1f661216.el8 ceph 880 k 2022-03-15T05:46:58.606 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-11109.g1f661216.el8 ceph 169 k 2022-03-15T05:46:58.607 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:17.0.0-11109.g1f661216.el8 ceph 1.5 M 2022-03-15T05:46:58.607 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 103 k 2022-03-15T05:46:58.607 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 1.6 M 2022-03-15T05:46:58.607 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 7.4 M 2022-03-15T05:46:58.607 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 47 k 2022-03-15T05:46:58.608 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:17.0.0-11109.g1f661216.el8 ceph 9.3 M 2022-03-15T05:46:58.608 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:17.0.0-11109.g1f661216.el8 ceph 45 M 2022-03-15T05:46:58.608 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 257 k 2022-03-15T05:46:58.608 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 71 k 2022-03-15T05:46:58.609 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:17.0.0-11109.g1f661216.el8 ceph 272 k 2022-03-15T05:46:58.609 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 14 k 2022-03-15T05:46:58.609 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 CentOS-Base 60 k 2022-03-15T05:46:58.609 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.1-9.el8 CentOS-AppStream 320 k 2022-03-15T05:46:58.609 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-Base 19 k 2022-03-15T05:46:58.610 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:17.0.0-11109.g1f661216.el8 ceph 25 k 2022-03-15T05:46:58.610 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:17.0.0-11109.g1f661216.el8 ceph 794 k 2022-03-15T05:46:58.610 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:17.0.0-11109.g1f661216.el8 ceph 125 k 2022-03-15T05:46:58.610 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:17.0.0-11109.g1f661216.el8 ceph 3.4 M 2022-03-15T05:46:58.611 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:17.0.0-11109.g1f661216.el8 ceph 3.9 M 2022-03-15T05:46:58.611 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-25.el8 CentOS-AppStream 709 k 2022-03-15T05:46:58.611 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.32.1-34.el8 CentOS-Base 98 k 2022-03-15T05:46:58.612 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:1.1.1k-5.el8_5 CentOS-Base 2.3 M 2022-03-15T05:46:58.612 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:17.0.0-11109.g1f661216.el8 ceph 179 k 2022-03-15T05:46:58.612 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:17.0.0-11109.g1f661216.el8 ceph 366 k 2022-03-15T05:46:58.612 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:17.0.0-11109.g1f661216.el8 ceph 345 k 2022-03-15T05:46:58.613 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:17.0.0-11109.g1f661216.el8 ceph 109 k 2022-03-15T05:46:58.613 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:17.0.0-11109.g1f661216.el8 ceph 93 k 2022-03-15T05:46:58.613 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:17.0.0-11109.g1f661216.el8 ceph 3.8 M 2022-03-15T05:46:58.613 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:17.0.0-11109.g1f661216.el8 ceph 175 k 2022-03-15T05:46:58.613 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 CentOS-Base 72 k 2022-03-15T05:46:58.614 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2022-03-15T05:46:58.614 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.36.0-2.el8 CentOS-Base 2.3 M 2022-03-15T05:46:58.614 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.36.0-2.el8 CentOS-Base 1.8 M 2022-03-15T05:46:58.614 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.36.0-2.el8 CentOS-Base 152 k 2022-03-15T05:46:58.615 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.36.0-2.el8 CentOS-Base 345 k 2022-03-15T05:46:58.615 INFO:teuthology.orchestra.run.smithi151.stdout: iproute x86_64 5.15.0-3.el8 CentOS-Base 796 k 2022-03-15T05:46:58.615 INFO:teuthology.orchestra.run.smithi151.stdout: libblkid x86_64 2.32.1-34.el8 CentOS-Base 218 k 2022-03-15T05:46:58.615 INFO:teuthology.orchestra.run.smithi151.stdout: libfdisk x86_64 2.32.1-34.el8 CentOS-Base 252 k 2022-03-15T05:46:58.616 INFO:teuthology.orchestra.run.smithi151.stdout: libmount x86_64 2.32.1-34.el8 CentOS-Base 235 k 2022-03-15T05:46:58.616 INFO:teuthology.orchestra.run.smithi151.stdout: libsmartcols x86_64 2.32.1-34.el8 CentOS-Base 178 k 2022-03-15T05:46:58.616 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid x86_64 2.32.1-34.el8 CentOS-Base 97 k 2022-03-15T05:46:58.616 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux x86_64 2.32.1-34.el8 CentOS-Base 2.5 M 2022-03-15T05:46:58.616 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux-user x86_64 2.32.1-34.el8 CentOS-Base 101 k 2022-03-15T05:46:58.617 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump x86_64 3.1.8-4.el8 CentOS-Base 332 k 2022-03-15T05:46:58.617 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2022-03-15T05:46:58.617 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.1-7.el8 CentOS-AppStream 713 k 2022-03-15T05:46:58.617 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:17.0.0-11109.g1f661216.el8 ceph 20 M 2022-03-15T05:46:58.618 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 23 k 2022-03-15T05:46:58.618 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:17.0.0-11109.g1f661216.el8 ceph 2.3 M 2022-03-15T05:46:58.618 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 226 k 2022-03-15T05:46:58.618 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:17.0.0-11109.g1f661216.el8 ceph 3.9 M 2022-03-15T05:46:58.619 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:17.0.0-11109.g1f661216.el8 ceph 17 M 2022-03-15T05:46:58.619 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:17.0.0-11109.g1f661216.el8 ceph-noarch 15 k 2022-03-15T05:46:58.619 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:17.0.0-11109.g1f661216.el8 ceph 24 k 2022-03-15T05:46:58.619 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2022-03-15T05:46:58.619 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2022-03-15T05:46:58.620 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-3.el8 CentOS-AppStream 202 k 2022-03-15T05:46:58.620 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 CentOS-Base 48 k 2022-03-15T05:46:58.620 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel x86_64 1.18.2-14.el8 CentOS-Base 560 k 2022-03-15T05:46:58.620 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:17.0.0-11109.g1f661216.el8 ceph 170 k 2022-03-15T05:46:58.621 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel x86_64 1.45.6-2.el8 CentOS-Base 38 k 2022-03-15T05:46:58.621 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 8.5.0-10.el8 CentOS-Base 643 k 2022-03-15T05:46:58.621 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2022-03-15T05:46:58.621 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 8.5.0-10.el8 CentOS-Base 171 k 2022-03-15T05:46:58.622 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2022-03-15T05:46:58.622 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:17.0.0-11109.g1f661216.el8 ceph 483 k 2022-03-15T05:46:58.622 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 0.11.4-3.el8 CentOS-AppStream 354 k 2022-03-15T05:46:58.622 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:17.0.0-11109.g1f661216.el8 ceph 4.0 M 2022-03-15T05:46:58.622 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel x86_64 2.9-5.el8 CentOS-Base 200 k 2022-03-15T05:46:58.623 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel x86_64 2.9-3.el8 CentOS-Base 87 k 2022-03-15T05:46:58.623 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2022-03-15T05:46:58.623 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel x86_64 0.3.0-5.el8 CentOS-Base 18 k 2022-03-15T05:46:58.623 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2022-03-15T05:46:58.624 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2022-03-15T05:46:58.624 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.15-3.el8 CentOS-AppStream 4.7 M 2022-03-15T05:46:58.624 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads x86_64 0.3.15-3.el8 CentOS-AppStream 4.9 M 2022-03-15T05:46:58.624 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel x86_64 10.32-2.el8 CentOS-Base 605 k 2022-03-15T05:46:58.625 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16 x86_64 10.32-2.el8 CentOS-Base 229 k 2022-03-15T05:46:58.625 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32 x86_64 10.32-2.el8 CentOS-Base 220 k 2022-03-15T05:46:58.625 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2022-03-15T05:46:58.625 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2022-03-15T05:46:58.625 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2022-03-15T05:46:58.626 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2022-03-15T05:46:58.626 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2022-03-15T05:46:58.626 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:17.0.0-11109.g1f661216.el8 ceph 45 k 2022-03-15T05:46:58.626 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:17.0.0-11109.g1f661216.el8 ceph 104 k 2022-03-15T05:46:58.627 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2022-03-15T05:46:58.627 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2022-03-15T05:46:58.627 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2022-03-15T05:46:58.627 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2022-03-15T05:46:58.628 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2022-03-15T05:46:58.628 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2022-03-15T05:46:58.628 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2022-03-15T05:46:58.628 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2022-03-15T05:46:58.628 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2022-03-15T05:46:58.629 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2022-03-15T05:46:58.629 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2022-03-15T05:46:58.629 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2022-03-15T05:46:58.629 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2022-03-15T05:46:58.630 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2022-03-15T05:46:58.630 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2022-03-15T05:46:58.630 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2022-03-15T05:46:58.630 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2022-03-15T05:46:58.630 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2022-03-15T05:46:58.631 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2022-03-15T05:46:58.631 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2022-03-15T05:46:58.631 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2022-03-15T05:46:58.631 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2022-03-15T05:46:58.632 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2022-03-15T05:46:58.632 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2022-03-15T05:46:58.632 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2022-03-15T05:46:58.632 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2022-03-15T05:46:58.632 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2022-03-15T05:46:58.633 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2022-03-15T05:46:58.633 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2022-03-15T05:46:58.633 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2022-03-15T05:46:58.633 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2022-03-15T05:46:58.634 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2022-03-15T05:46:58.634 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2022-03-15T05:46:58.634 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2022-03-15T05:46:58.634 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2022-03-15T05:46:58.634 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2022-03-15T05:46:58.635 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2022-03-15T05:46:58.635 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2022-03-15T05:46:58.635 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2022-03-15T05:46:58.635 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2022-03-15T05:46:58.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2022-03-15T05:46:58.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2022-03-15T05:46:58.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2022-03-15T05:46:58.636 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2022-03-15T05:46:58.636 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2022-03-15T05:46:58.637 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2022-03-15T05:46:58.637 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-17.el8 CentOS-Base 58 k 2022-03-15T05:46:58.637 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:46:58.637 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2022-03-15T05:46:58.638 INFO:teuthology.orchestra.run.smithi151.stdout:========================================================================================================= 2022-03-15T05:46:58.638 INFO:teuthology.orchestra.run.smithi151.stdout:Install 124 Packages 2022-03-15T05:46:58.638 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 13 Packages 2022-03-15T05:46:58.638 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:46:58.639 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 191 M 2022-03-15T05:46:58.639 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2022-03-15T05:46:58.816 INFO:teuthology.orchestra.run.smithi151.stdout:(1/137): ceph-17.0.0-11109.g1f661216.el8.x86_64 35 kB/s | 6.5 kB 00:00 2022-03-15T05:46:58.907 INFO:teuthology.orchestra.run.smithi164.stdout:(8/137): ceph-common-17.0.0-11109.g1f661216.el8 9.2 MB/s | 20 MB 00:02 2022-03-15T05:46:58.982 INFO:teuthology.orchestra.run.smithi164.stdout:(9/137): ceph-selinux-17.0.0-11109.g1f661216.el 325 kB/s | 24 kB 00:00 2022-03-15T05:46:59.566 INFO:teuthology.orchestra.run.smithi164.stdout:(10/137): ceph-radosgw-17.0.0-11109.g1f661216.e 6.5 MB/s | 9.3 MB 00:01 2022-03-15T05:46:59.607 INFO:teuthology.orchestra.run.smithi151.stdout:(2/137): ceph-fuse-17.0.0-11109.g1f661216.el8.x 1.1 MB/s | 880 kB 00:00 2022-03-15T05:46:59.724 INFO:teuthology.orchestra.run.smithi151.stdout:(3/137): ceph-immutable-object-cache-17.0.0-111 1.4 MB/s | 169 kB 00:00 2022-03-15T05:46:59.774 INFO:teuthology.orchestra.run.smithi164.stdout:(11/137): ceph-osd-17.0.0-11109.g1f661216.el8.x 8.2 MB/s | 17 MB 00:02 2022-03-15T05:46:59.799 INFO:teuthology.orchestra.run.smithi164.stdout:(12/137): cephfs-mirror-17.0.0-11109.g1f661216. 1.1 MB/s | 272 kB 00:00 2022-03-15T05:46:59.825 INFO:teuthology.orchestra.run.smithi164.stdout:(13/137): libcephfs-devel-17.0.0-11109.g1f66121 496 kB/s | 25 kB 00:00 2022-03-15T05:46:59.892 INFO:teuthology.orchestra.run.smithi164.stdout:(14/137): libcephsqlite-17.0.0-11109.g1f661216. 2.5 MB/s | 170 kB 00:00 2022-03-15T05:46:59.959 INFO:teuthology.orchestra.run.smithi164.stdout:(15/137): libcephfs2-17.0.0-11109.g1f661216.el8 4.9 MB/s | 794 kB 00:00 2022-03-15T05:46:59.984 INFO:teuthology.orchestra.run.smithi164.stdout:(16/137): librados-devel-17.0.0-11109.g1f661216 1.3 MB/s | 125 kB 00:00 2022-03-15T05:47:00.159 INFO:teuthology.orchestra.run.smithi164.stdout:(17/137): libradosstriper1-17.0.0-11109.g1f6612 2.7 MB/s | 483 kB 00:00 2022-03-15T05:47:00.242 INFO:teuthology.orchestra.run.smithi151.stdout:(4/137): ceph-base-17.0.0-11109.g1f661216.el8.x 3.3 MB/s | 5.3 MB 00:01 2022-03-15T05:47:00.693 INFO:teuthology.orchestra.run.smithi164.stdout:(18/137): librados2-17.0.0-11109.g1f661216.el8. 4.7 MB/s | 3.4 MB 00:00 2022-03-15T05:47:00.868 INFO:teuthology.orchestra.run.smithi164.stdout:(19/137): librbd1-17.0.0-11109.g1f661216.el8.x8 5.5 MB/s | 3.9 MB 00:00 2022-03-15T05:47:00.873 INFO:teuthology.orchestra.run.smithi151.stdout:(5/137): ceph-mgr-17.0.0-11109.g1f661216.el8.x8 2.4 MB/s | 1.5 MB 00:00 2022-03-15T05:47:00.927 INFO:teuthology.orchestra.run.smithi164.stdout:(20/137): python3-ceph-argparse-17.0.0-11109.g1 765 kB/s | 45 kB 00:00 2022-03-15T05:47:01.019 INFO:teuthology.orchestra.run.smithi164.stdout:(21/137): python3-ceph-common-17.0.0-11109.g1f6 1.1 MB/s | 104 kB 00:00 2022-03-15T05:47:01.119 INFO:teuthology.orchestra.run.smithi164.stdout:(22/137): python3-cephfs-17.0.0-11109.g1f661216 1.7 MB/s | 179 kB 00:00 2022-03-15T05:47:01.219 INFO:teuthology.orchestra.run.smithi164.stdout:(23/137): python3-rados-17.0.0-11109.g1f661216. 3.6 MB/s | 366 kB 00:00 2022-03-15T05:47:01.319 INFO:teuthology.orchestra.run.smithi164.stdout:(24/137): python3-rbd-17.0.0-11109.g1f661216.el 3.4 MB/s | 345 kB 00:00 2022-03-15T05:47:01.411 INFO:teuthology.orchestra.run.smithi164.stdout:(25/137): python3-rgw-17.0.0-11109.g1f661216.el 1.2 MB/s | 109 kB 00:00 2022-03-15T05:47:01.451 INFO:teuthology.orchestra.run.smithi151.stdout:(6/137): ceph-mds-17.0.0-11109.g1f661216.el8.x8 1.3 MB/s | 2.3 MB 00:01 2022-03-15T05:47:01.478 INFO:teuthology.orchestra.run.smithi164.stdout:(26/137): librgw2-17.0.0-11109.g1f661216.el8.x8 5.1 MB/s | 4.0 MB 00:00 2022-03-15T05:47:01.495 INFO:teuthology.orchestra.run.smithi164.stdout:(27/137): rbd-fuse-17.0.0-11109.g1f661216.el8.x 1.1 MB/s | 93 kB 00:00 2022-03-15T05:47:01.587 INFO:teuthology.orchestra.run.smithi164.stdout:(28/137): rbd-nbd-17.0.0-11109.g1f661216.el8.x8 1.9 MB/s | 175 kB 00:00 2022-03-15T05:47:01.679 INFO:teuthology.orchestra.run.smithi164.stdout:(29/137): ceph-grafana-dashboards-17.0.0-11109. 246 kB/s | 23 kB 00:00 2022-03-15T05:47:01.796 INFO:teuthology.orchestra.run.smithi164.stdout:(30/137): ceph-mgr-cephadm-17.0.0-11109.g1f6612 883 kB/s | 103 kB 00:00 2022-03-15T05:47:02.147 INFO:teuthology.orchestra.run.smithi164.stdout:(31/137): ceph-mgr-dashboard-17.0.0-11109.g1f66 4.6 MB/s | 1.6 MB 00:00 2022-03-15T05:47:02.256 INFO:teuthology.orchestra.run.smithi164.stdout:(32/137): rbd-mirror-17.0.0-11109.g1f661216.el8 4.9 MB/s | 3.8 MB 00:00 2022-03-15T05:47:02.284 INFO:teuthology.orchestra.run.smithi151.stdout:(7/137): ceph-mon-17.0.0-11109.g1f661216.el8.x8 2.7 MB/s | 3.9 MB 00:01 2022-03-15T05:47:02.347 INFO:teuthology.orchestra.run.smithi164.stdout:(33/137): ceph-mgr-modules-core-17.0.0-11109.g1 2.4 MB/s | 226 kB 00:00 2022-03-15T05:47:02.439 INFO:teuthology.orchestra.run.smithi164.stdout:(34/137): ceph-mgr-rook-17.0.0-11109.g1f661216. 513 kB/s | 47 kB 00:00 2022-03-15T05:47:02.540 INFO:teuthology.orchestra.run.smithi164.stdout:(35/137): ceph-prometheus-alerts-17.0.0-11109.g 146 kB/s | 15 kB 00:00 2022-03-15T05:47:02.948 INFO:teuthology.orchestra.run.smithi164.stdout:(36/137): ceph-test-17.0.0-11109.g1f661216.el8. 11 MB/s | 45 MB 00:03 2022-03-15T05:47:02.973 INFO:teuthology.orchestra.run.smithi164.stdout:(37/137): ceph-volume-17.0.0-11109.g1f661216.el 593 kB/s | 257 kB 00:00 2022-03-15T05:47:03.024 INFO:teuthology.orchestra.run.smithi164.stdout:(38/137): cephadm-17.0.0-11109.g1f661216.el8.no 945 kB/s | 71 kB 00:00 2022-03-15T05:47:03.049 INFO:teuthology.orchestra.run.smithi164.stdout:(39/137): cephfs-top-17.0.0-11109.g1f661216.el8 191 kB/s | 14 kB 00:00 2022-03-15T05:47:03.208 INFO:teuthology.orchestra.run.smithi164.stdout:(40/137): ceph-mgr-diskprediction-local-17.0.0- 7.0 MB/s | 7.4 MB 00:01 2022-03-15T05:47:03.250 INFO:teuthology.orchestra.run.smithi164.stdout:(41/137): automake-1.16.1-7.el8.noarch.rpm 3.1 MB/s | 713 kB 00:00 2022-03-15T05:47:03.283 INFO:teuthology.orchestra.run.smithi164.stdout:(42/137): bison-3.0.4-10.el8.x86_64.rpm 2.9 MB/s | 688 kB 00:00 2022-03-15T05:47:03.309 INFO:teuthology.orchestra.run.smithi164.stdout:(43/137): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2022-03-15T05:47:03.334 INFO:teuthology.orchestra.run.smithi164.stdout:(44/137): librdkafka-0.11.4-3.el8.x86_64.rpm 6.9 MB/s | 354 kB 00:00 2022-03-15T05:47:03.359 INFO:teuthology.orchestra.run.smithi164.stdout:(45/137): flex-2.6.1-9.el8.x86_64.rpm 2.1 MB/s | 320 kB 00:00 2022-03-15T05:47:03.384 INFO:teuthology.orchestra.run.smithi164.stdout:(46/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2022-03-15T05:47:03.443 INFO:teuthology.orchestra.run.smithi164.stdout:(47/137): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2022-03-15T05:47:03.477 INFO:teuthology.orchestra.run.smithi164.stdout:(48/137): libtool-2.4.6-25.el8.x86_64.rpm 4.1 MB/s | 709 kB 00:00 2022-03-15T05:47:03.510 INFO:teuthology.orchestra.run.smithi151.stdout:(8/137): ceph-common-17.0.0-11109.g1f661216.el8 4.2 MB/s | 20 MB 00:04 2022-03-15T05:47:03.552 INFO:teuthology.orchestra.run.smithi151.stdout:(9/137): ceph-selinux-17.0.0-11109.g1f661216.el 592 kB/s | 24 kB 00:00 2022-03-15T05:47:03.877 INFO:teuthology.orchestra.run.smithi164.stdout:(49/137): openblas-0.3.15-3.el8.x86_64.rpm 9.6 MB/s | 4.7 MB 00:00 2022-03-15T05:47:03.969 INFO:teuthology.orchestra.run.smithi164.stdout:(50/137): python3-jinja2-2.10.1-3.el8.noarch.rp 5.8 MB/s | 538 kB 00:00 2022-03-15T05:47:04.011 INFO:teuthology.orchestra.run.smithi151.stdout:(10/137): ceph-radosgw-17.0.0-11109.g1f661216.e 5.4 MB/s | 9.3 MB 00:01 2022-03-15T05:47:04.027 INFO:teuthology.orchestra.run.smithi164.stdout:(51/137): python3-babel-2.5.1-7.el8.noarch.rpm 8.7 MB/s | 4.8 MB 00:00 2022-03-15T05:47:04.044 INFO:teuthology.orchestra.run.smithi164.stdout:(52/137): python3-jsonpatch-1.21-2.el8.noarch.r 353 kB/s | 27 kB 00:00 2022-03-15T05:47:04.061 INFO:teuthology.orchestra.run.smithi164.stdout:(53/137): python3-jsonpointer-1.10-11.el8.noarc 594 kB/s | 20 kB 00:00 2022-03-15T05:47:04.085 INFO:teuthology.orchestra.run.smithi151.stdout:(11/137): cephfs-mirror-17.0.0-11109.g1f661216. 3.6 MB/s | 272 kB 00:00 2022-03-15T05:47:04.086 INFO:teuthology.orchestra.run.smithi164.stdout:(54/137): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2022-03-15T05:47:04.112 INFO:teuthology.orchestra.run.smithi164.stdout:(55/137): python3-markupsafe-0.23-19.el8.x86_64 772 kB/s | 39 kB 00:00 2022-03-15T05:47:04.136 INFO:teuthology.orchestra.run.smithi151.stdout:(12/137): libcephfs-devel-17.0.0-11109.g1f66121 496 kB/s | 25 kB 00:00 2022-03-15T05:47:04.145 INFO:teuthology.orchestra.run.smithi164.stdout:(56/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 6.7 MB/s | 225 kB 00:00 2022-03-15T05:47:04.237 INFO:teuthology.orchestra.run.smithi164.stdout:(57/137): openblas-threads-0.3.15-3.el8.x86_64. 6.1 MB/s | 4.9 MB 00:00 2022-03-15T05:47:04.262 INFO:teuthology.orchestra.run.smithi151.stdout:(13/137): libcephfs2-17.0.0-11109.g1f661216.el8 6.2 MB/s | 794 kB 00:00 2022-03-15T05:47:04.263 INFO:teuthology.orchestra.run.smithi164.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 375 kB/s | 44 kB 00:00 2022-03-15T05:47:04.280 INFO:teuthology.orchestra.run.smithi164.stdout:(59/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.4 MB/s | 103 kB 00:00 2022-03-15T05:47:04.305 INFO:teuthology.orchestra.run.smithi164.stdout:(60/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 3.0 MB/s | 126 kB 00:00 2022-03-15T05:47:04.321 INFO:teuthology.orchestra.run.smithi151.stdout:(14/137): libcephsqlite-17.0.0-11109.g1f661216. 2.9 MB/s | 170 kB 00:00 2022-03-15T05:47:04.339 INFO:teuthology.orchestra.run.smithi164.stdout:(61/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2022-03-15T05:47:04.364 INFO:teuthology.orchestra.run.smithi164.stdout:(62/137): python3-pytz-2017.2-9.el8.noarch.rpm 922 kB/s | 54 kB 00:00 2022-03-15T05:47:04.370 INFO:teuthology.orchestra.run.smithi151.stdout:(15/137): librados-devel-17.0.0-11109.g1f661216 2.4 MB/s | 125 kB 00:00 2022-03-15T05:47:04.415 INFO:teuthology.orchestra.run.smithi164.stdout:(63/137): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2022-03-15T05:47:04.456 INFO:teuthology.orchestra.run.smithi164.stdout:(64/137): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2022-03-15T05:47:04.523 INFO:teuthology.orchestra.run.smithi164.stdout:(65/137): python3-numpy-1.14.3-10.el8.x86_64.rp 8.6 MB/s | 3.7 MB 00:00 2022-03-15T05:47:04.549 INFO:teuthology.orchestra.run.smithi164.stdout:(66/137): NetworkManager-initscripts-updown-1.3 1.5 MB/s | 137 kB 00:00 2022-03-15T05:47:04.583 INFO:teuthology.orchestra.run.smithi164.stdout:(67/137): fuse-2.9.7-12.el8.x86_64.rpm 2.4 MB/s | 82 kB 00:00 2022-03-15T05:47:04.650 INFO:teuthology.orchestra.run.smithi164.stdout:(68/137): elfutils-libelf-devel-0.186-1.el8.x86 475 kB/s | 60 kB 00:00 2022-03-15T05:47:04.716 INFO:teuthology.orchestra.run.smithi164.stdout:(69/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 360 kB/s | 48 kB 00:00 2022-03-15T05:47:04.792 INFO:teuthology.orchestra.run.smithi164.stdout:(70/137): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.9 MB/s | 560 kB 00:00 2022-03-15T05:47:04.817 INFO:teuthology.orchestra.run.smithi164.stdout:(71/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 186 kB/s | 19 kB 00:00 2022-03-15T05:47:04.821 INFO:teuthology.orchestra.run.smithi151.stdout:(16/137): librados2-17.0.0-11109.g1f661216.el8. 7.6 MB/s | 3.4 MB 00:00 2022-03-15T05:47:04.850 INFO:teuthology.orchestra.run.smithi164.stdout:(72/137): libcom_err-devel-1.45.6-2.el8.x86_64. 654 kB/s | 38 kB 00:00 2022-03-15T05:47:04.884 INFO:teuthology.orchestra.run.smithi164.stdout:(73/137): libquadmath-8.5.0-10.el8.x86_64.rpm 5.0 MB/s | 171 kB 00:00 2022-03-15T05:47:04.909 INFO:teuthology.orchestra.run.smithi164.stdout:(74/137): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.8 MB/s | 47 kB 00:00 2022-03-15T05:47:04.934 INFO:teuthology.orchestra.run.smithi164.stdout:(75/137): libgfortran-8.5.0-10.el8.x86_64.rpm 5.4 MB/s | 643 kB 00:00 2022-03-15T05:47:04.937 INFO:teuthology.orchestra.run.smithi151.stdout:(17/137): libradosstriper1-17.0.0-11109.g1f6612 4.1 MB/s | 483 kB 00:00 2022-03-15T05:47:04.985 INFO:teuthology.orchestra.run.smithi164.stdout:(76/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2022-03-15T05:47:05.010 INFO:teuthology.orchestra.run.smithi164.stdout:(77/137): libselinux-devel-2.9-5.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2022-03-15T05:47:05.069 INFO:teuthology.orchestra.run.smithi164.stdout:(78/137): libuuid-devel-2.32.1-34.el8.x86_64.rp 1.1 MB/s | 98 kB 00:00 2022-03-15T05:47:05.094 INFO:teuthology.orchestra.run.smithi164.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 213 kB/s | 18 kB 00:00 2022-03-15T05:47:05.294 INFO:teuthology.orchestra.run.smithi164.stdout:(80/137): python3-scipy-1.0.0-21.module_el8.5.0 14 MB/s | 14 MB 00:00 2022-03-15T05:47:05.336 INFO:teuthology.orchestra.run.smithi164.stdout:(81/137): pcre2-devel-10.32-2.el8.x86_64.rpm 2.4 MB/s | 605 kB 00:00 2022-03-15T05:47:05.362 INFO:teuthology.orchestra.run.smithi164.stdout:(82/137): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.4 MB/s | 229 kB 00:00 2022-03-15T05:47:05.395 INFO:teuthology.orchestra.run.smithi164.stdout:(83/137): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2022-03-15T05:47:05.429 INFO:teuthology.orchestra.run.smithi164.stdout:(84/137): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 237 kB 00:00 2022-03-15T05:47:05.430 INFO:teuthology.orchestra.run.smithi151.stdout:(18/137): librbd1-17.0.0-11109.g1f661216.el8.x8 7.9 MB/s | 3.9 MB 00:00 2022-03-15T05:47:05.481 INFO:teuthology.orchestra.run.smithi164.stdout:(85/137): python3-jwt-1.6.1-2.el8.noarch.rpm 835 kB/s | 43 kB 00:00 2022-03-15T05:47:05.521 INFO:teuthology.orchestra.run.smithi164.stdout:(86/137): python3-oauthlib-2.1.0-1.el8.noarch.r 3.7 MB/s | 155 kB 00:00 2022-03-15T05:47:05.546 INFO:teuthology.orchestra.run.smithi164.stdout:(87/137): python3-cryptography-3.2.1-5.el8.x86_ 3.6 MB/s | 559 kB 00:00 2022-03-15T05:47:05.572 INFO:teuthology.orchestra.run.smithi164.stdout:(88/137): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2022-03-15T05:47:05.598 INFO:teuthology.orchestra.run.smithi164.stdout:(89/137): python3-requests-oauthlib-1.0.0-1.el8 844 kB/s | 43 kB 00:00 2022-03-15T05:47:05.639 INFO:teuthology.orchestra.run.smithi164.stdout:(90/137): openssl-devel-1.1.1k-5.el8_5.x86_64.r 4.1 MB/s | 2.3 MB 00:00 2022-03-15T05:47:05.665 INFO:teuthology.orchestra.run.smithi164.stdout:(91/137): zlib-devel-1.2.11-17.el8.x86_64.rpm 861 kB/s | 58 kB 00:00 2022-03-15T05:47:05.690 INFO:teuthology.orchestra.run.smithi164.stdout:(92/137): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 614 kB/s | 72 kB 00:00 2022-03-15T05:47:05.815 INFO:teuthology.orchestra.run.smithi164.stdout:(93/137): liboath-2.6.2-3.el8.x86_64.rpm 392 kB/s | 59 kB 00:00 2022-03-15T05:47:05.832 INFO:teuthology.orchestra.run.smithi164.stdout:(94/137): libunwind-1.3.1-3.el8.x86_64.rpm 529 kB/s | 75 kB 00:00 2022-03-15T05:47:05.905 INFO:teuthology.orchestra.run.smithi151.stdout:(19/137): librgw2-17.0.0-11109.g1f661216.el8.x8 8.4 MB/s | 4.0 MB 00:00 2022-03-15T05:47:05.916 INFO:teuthology.orchestra.run.smithi164.stdout:(95/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 523 kB/s | 44 kB 00:00 2022-03-15T05:47:05.941 INFO:teuthology.orchestra.run.smithi164.stdout:(96/137): gperftools-libs-2.7-9.el8.x86_64.rpm 1.0 MB/s | 306 kB 00:00 2022-03-15T05:47:05.956 INFO:teuthology.orchestra.run.smithi151.stdout:(20/137): python3-ceph-argparse-17.0.0-11109.g1 898 kB/s | 45 kB 00:00 2022-03-15T05:47:05.974 INFO:teuthology.orchestra.run.smithi164.stdout:(97/137): python3-beautifulsoup4-4.6.3-2.el8.1. 3.1 MB/s | 185 kB 00:00 2022-03-15T05:47:06.000 INFO:teuthology.orchestra.run.smithi164.stdout:(98/137): python3-cachetools-3.1.1-4.el8.noarch 565 kB/s | 33 kB 00:00 2022-03-15T05:47:06.023 INFO:teuthology.orchestra.run.smithi151.stdout:(21/137): python3-ceph-common-17.0.0-11109.g1f6 1.5 MB/s | 104 kB 00:00 2022-03-15T05:47:06.025 INFO:teuthology.orchestra.run.smithi164.stdout:(99/137): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2022-03-15T05:47:06.051 INFO:teuthology.orchestra.run.smithi164.stdout:(100/137): python3-certifi-2018.10.15-7.el8.noa 215 kB/s | 16 kB 00:00 2022-03-15T05:47:06.076 INFO:teuthology.orchestra.run.smithi164.stdout:(101/137): python3-cheroot-8.5.2-1.el8.noarch.r 2.2 MB/s | 173 kB 00:00 2022-03-15T05:47:06.082 INFO:teuthology.orchestra.run.smithi151.stdout:(22/137): python3-cephfs-17.0.0-11109.g1f661216 3.0 MB/s | 179 kB 00:00 2022-03-15T05:47:06.101 INFO:teuthology.orchestra.run.smithi164.stdout:(102/137): python3-google-auth-1.1.1-10.el8.noa 1.6 MB/s | 81 kB 00:00 2022-03-15T05:47:06.126 INFO:teuthology.orchestra.run.smithi164.stdout:(103/137): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2022-03-15T05:47:06.152 INFO:teuthology.orchestra.run.smithi164.stdout:(104/137): python3-jaraco-functools-2.0-4.el8.n 350 kB/s | 18 kB 00:00 2022-03-15T05:47:06.177 INFO:teuthology.orchestra.run.smithi164.stdout:(105/137): python3-cherrypy-18.4.0-1.el8.noarch 2.5 MB/s | 384 kB 00:00 2022-03-15T05:47:06.202 INFO:teuthology.orchestra.run.smithi164.stdout:(106/137): python3-logutils-0.3.5-11.el8.noarch 970 kB/s | 49 kB 00:00 2022-03-15T05:47:06.227 INFO:teuthology.orchestra.run.smithi164.stdout:(107/137): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2022-03-15T05:47:06.253 INFO:teuthology.orchestra.run.smithi164.stdout:(108/137): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2022-03-15T05:47:06.328 INFO:teuthology.orchestra.run.smithi164.stdout:(109/137): python3-kubernetes-11.0.0-6.el8.noar 5.8 MB/s | 1.2 MB 00:00 2022-03-15T05:47:06.353 INFO:teuthology.orchestra.run.smithi164.stdout:(110/137): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2022-03-15T05:47:06.366 INFO:teuthology.orchestra.run.smithi151.stdout:(23/137): ceph-osd-17.0.0-11109.g1f661216.el8.x 3.4 MB/s | 17 MB 00:04 2022-03-15T05:47:06.379 INFO:teuthology.orchestra.run.smithi164.stdout:(111/137): python3-pecan-1.3.2-9.el8.noarch.rpm 1.8 MB/s | 283 kB 00:00 2022-03-15T05:47:06.391 INFO:teuthology.orchestra.run.smithi151.stdout:(24/137): python3-rados-17.0.0-11109.g1f661216. 1.2 MB/s | 366 kB 00:00 2022-03-15T05:47:06.404 INFO:teuthology.orchestra.run.smithi164.stdout:(112/137): python3-repoze-lru-0.7-6.el8.noarch. 446 kB/s | 34 kB 00:00 2022-03-15T05:47:06.429 INFO:teuthology.orchestra.run.smithi164.stdout:(113/137): python3-routes-2.4.1-12.el8.noarch.r 2.5 MB/s | 196 kB 00:00 2022-03-15T05:47:06.449 INFO:teuthology.orchestra.run.smithi151.stdout:(25/137): python3-rgw-17.0.0-11109.g1f661216.el 1.8 MB/s | 109 kB 00:00 2022-03-15T05:47:06.454 INFO:teuthology.orchestra.run.smithi164.stdout:(114/137): python3-rsa-4.8-1.el8.noarch.rpm 816 kB/s | 61 kB 00:00 2022-03-15T05:47:06.475 INFO:teuthology.orchestra.run.smithi151.stdout:(26/137): python3-rbd-17.0.0-11109.g1f661216.el 3.1 MB/s | 345 kB 00:00 2022-03-15T05:47:06.480 INFO:teuthology.orchestra.run.smithi164.stdout:(115/137): python3-simplegeneric-0.8.1-17.el8.n 248 kB/s | 19 kB 00:00 2022-03-15T05:47:06.501 INFO:teuthology.orchestra.run.smithi151.stdout:(27/137): rbd-fuse-17.0.0-11109.g1f661216.el8.x 1.8 MB/s | 93 kB 00:00 2022-03-15T05:47:06.505 INFO:teuthology.orchestra.run.smithi164.stdout:(116/137): python3-singledispatch-3.4.0.3-18.el 317 kB/s | 24 kB 00:00 2022-03-15T05:47:06.522 INFO:teuthology.orchestra.run.smithi164.stdout:(117/137): python3-tempora-1.14.1-5.el8.noarch. 435 kB/s | 29 kB 00:00 2022-03-15T05:47:06.547 INFO:teuthology.orchestra.run.smithi164.stdout:(118/137): python3-trustme-0.6.0-4.el8.noarch.r 409 kB/s | 27 kB 00:00 2022-03-15T05:47:06.559 INFO:teuthology.orchestra.run.smithi151.stdout:(28/137): rbd-nbd-17.0.0-11109.g1f661216.el8.x8 2.9 MB/s | 175 kB 00:00 2022-03-15T05:47:06.573 INFO:teuthology.orchestra.run.smithi164.stdout:(119/137): python3-waitress-1.2.1-2.el8.1.noarc 3.5 MB/s | 241 kB 00:00 2022-03-15T05:47:06.598 INFO:teuthology.orchestra.run.smithi164.stdout:(120/137): python3-webob-1.8.5-1.el8.1.noarch.r 3.2 MB/s | 251 kB 00:00 2022-03-15T05:47:06.610 INFO:teuthology.orchestra.run.smithi151.stdout:(29/137): ceph-grafana-dashboards-17.0.0-11109. 452 kB/s | 23 kB 00:00 2022-03-15T05:47:06.615 INFO:teuthology.orchestra.run.smithi164.stdout:(121/137): python3-websocket-client-0.56.0-5.el 911 kB/s | 61 kB 00:00 2022-03-15T05:47:06.640 INFO:teuthology.orchestra.run.smithi164.stdout:(122/137): python3-webtest-2.0.33-1.el8.noarch. 1.2 MB/s | 85 kB 00:00 2022-03-15T05:47:06.660 INFO:teuthology.orchestra.run.smithi151.stdout:(30/137): ceph-mgr-cephadm-17.0.0-11109.g1f6612 2.0 MB/s | 103 kB 00:00 2022-03-15T05:47:06.665 INFO:teuthology.orchestra.run.smithi164.stdout:(123/137): python3-zc-lockfile-2.0-2.el8.noarch 341 kB/s | 23 kB 00:00 2022-03-15T05:47:06.722 INFO:teuthology.orchestra.run.smithi164.stdout:(124/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 647 kB/s | 69 kB 00:00 2022-03-15T05:47:06.799 INFO:teuthology.orchestra.run.smithi164.stdout:(125/137): NetworkManager-team-1.36.0-2.el8.x86 1.9 MB/s | 152 kB 00:00 2022-03-15T05:47:06.841 INFO:teuthology.orchestra.run.smithi164.stdout:(126/137): NetworkManager-libnm-1.36.0-2.el8.x8 10 MB/s | 1.8 MB 00:00 2022-03-15T05:47:06.883 INFO:teuthology.orchestra.run.smithi164.stdout:(127/137): NetworkManager-1.36.0-2.el8.x86_64.r 9.3 MB/s | 2.3 MB 00:00 2022-03-15T05:47:06.919 INFO:teuthology.orchestra.run.smithi151.stdout:(31/137): ceph-mgr-dashboard-17.0.0-11109.g1f66 6.3 MB/s | 1.6 MB 00:00 2022-03-15T05:47:06.925 INFO:teuthology.orchestra.run.smithi164.stdout:(128/137): iproute-5.15.0-3.el8.x86_64.rpm 9.3 MB/s | 796 kB 00:00 2022-03-15T05:47:06.950 INFO:teuthology.orchestra.run.smithi164.stdout:(129/137): libblkid-2.32.1-34.el8.x86_64.rpm 3.2 MB/s | 218 kB 00:00 2022-03-15T05:47:06.976 INFO:teuthology.orchestra.run.smithi164.stdout:(130/137): NetworkManager-tui-1.36.0-2.el8.x86_ 1.9 MB/s | 345 kB 00:00 2022-03-15T05:47:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:(131/137): libfdisk-2.32.1-34.el8.x86_64.rpm 3.3 MB/s | 252 kB 00:00 2022-03-15T05:47:07.034 INFO:teuthology.orchestra.run.smithi164.stdout:(132/137): libmount-2.32.1-34.el8.x86_64.rpm 2.7 MB/s | 235 kB 00:00 2022-03-15T05:47:07.060 INFO:teuthology.orchestra.run.smithi164.stdout:(133/137): libuuid-2.32.1-34.el8.x86_64.rpm 1.6 MB/s | 97 kB 00:00 2022-03-15T05:47:07.085 INFO:teuthology.orchestra.run.smithi164.stdout:(134/137): libsmartcols-2.32.1-34.el8.x86_64.rp 1.6 MB/s | 178 kB 00:00 2022-03-15T05:47:07.135 INFO:teuthology.orchestra.run.smithi164.stdout:(135/137): util-linux-user-2.32.1-34.el8.x86_64 1.3 MB/s | 101 kB 00:00 2022-03-15T05:47:07.194 INFO:teuthology.orchestra.run.smithi164.stdout:(136/137): xfsdump-3.1.8-4.el8.x86_64.rpm 3.0 MB/s | 332 kB 00:00 2022-03-15T05:47:07.195 INFO:teuthology.orchestra.run.smithi151.stdout:(32/137): rbd-mirror-17.0.0-11109.g1f661216.el8 5.3 MB/s | 3.8 MB 00:00 2022-03-15T05:47:07.261 INFO:teuthology.orchestra.run.smithi164.stdout:(137/137): util-linux-2.32.1-34.el8.x86_64.rpm 11 MB/s | 2.5 MB 00:00 2022-03-15T05:47:07.265 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2022-03-15T05:47:07.266 INFO:teuthology.orchestra.run.smithi164.stdout:Total 18 MB/s | 191 MB 00:10 2022-03-15T05:47:07.269 INFO:teuthology.orchestra.run.smithi151.stdout:(33/137): ceph-mgr-modules-core-17.0.0-11109.g1 3.0 MB/s | 226 kB 00:00 2022-03-15T05:47:07.328 INFO:teuthology.orchestra.run.smithi151.stdout:(34/137): ceph-mgr-rook-17.0.0-11109.g1f661216. 804 kB/s | 47 kB 00:00 2022-03-15T05:47:07.387 INFO:teuthology.orchestra.run.smithi151.stdout:(35/137): ceph-prometheus-alerts-17.0.0-11109.g 251 kB/s | 15 kB 00:00 2022-03-15T05:47:07.471 INFO:teuthology.orchestra.run.smithi151.stdout:(36/137): ceph-volume-17.0.0-11109.g1f661216.el 3.0 MB/s | 257 kB 00:00 2022-03-15T05:47:07.538 INFO:teuthology.orchestra.run.smithi151.stdout:(37/137): cephadm-17.0.0-11109.g1f661216.el8.no 1.0 MB/s | 71 kB 00:00 2022-03-15T05:47:07.596 INFO:teuthology.orchestra.run.smithi151.stdout:(38/137): cephfs-top-17.0.0-11109.g1f661216.el8 246 kB/s | 14 kB 00:00 2022-03-15T05:47:07.663 INFO:teuthology.orchestra.run.smithi151.stdout:(39/137): automake-1.16.1-7.el8.noarch.rpm 11 MB/s | 713 kB 00:00 2022-03-15T05:47:07.705 INFO:teuthology.orchestra.run.smithi151.stdout:(40/137): bison-3.0.4-10.el8.x86_64.rpm 16 MB/s | 688 kB 00:00 2022-03-15T05:47:07.739 INFO:teuthology.orchestra.run.smithi151.stdout:(41/137): flex-2.6.1-9.el8.x86_64.rpm 9.4 MB/s | 320 kB 00:00 2022-03-15T05:47:07.781 INFO:teuthology.orchestra.run.smithi151.stdout:(42/137): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2022-03-15T05:47:07.815 INFO:teuthology.orchestra.run.smithi151.stdout:(43/137): librdkafka-0.11.4-3.el8.x86_64.rpm 10 MB/s | 354 kB 00:00 2022-03-15T05:47:07.882 INFO:teuthology.orchestra.run.smithi151.stdout:(44/137): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2022-03-15T05:47:07.916 INFO:teuthology.orchestra.run.smithi151.stdout:(45/137): lttng-ust-2.8.1-11.el8.x86_64.rpm 7.7 MB/s | 259 kB 00:00 2022-03-15T05:47:08.033 INFO:teuthology.orchestra.run.smithi151.stdout:(46/137): ceph-mgr-diskprediction-local-17.0.0- 6.6 MB/s | 7.4 MB 00:01 2022-03-15T05:47:08.068 INFO:teuthology.orchestra.run.smithi151.stdout:(47/137): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2022-03-15T05:47:08.112 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2022-03-15T05:47:08.259 INFO:teuthology.orchestra.run.smithi151.stdout:(48/137): openblas-threads-0.3.15-3.el8.x86_64. 25 MB/s | 4.9 MB 00:00 2022-03-15T05:47:08.265 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2022-03-15T05:47:08.266 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2022-03-15T05:47:08.701 INFO:teuthology.orchestra.run.smithi151.stdout:(49/137): ceph-test-17.0.0-11109.g1f661216.el8. 8.8 MB/s | 45 MB 00:05 2022-03-15T05:47:08.802 INFO:teuthology.orchestra.run.smithi151.stdout:(50/137): openblas-0.3.15-3.el8.x86_64.rpm 6.2 MB/s | 4.7 MB 00:00 2022-03-15T05:47:08.827 INFO:teuthology.orchestra.run.smithi151.stdout:(51/137): python3-jsonpatch-1.21-2.el8.noarch.r 1.1 MB/s | 27 kB 00:00 2022-03-15T05:47:08.852 INFO:teuthology.orchestra.run.smithi151.stdout:(52/137): python3-jsonpointer-1.10-11.el8.noarc 797 kB/s | 20 kB 00:00 2022-03-15T05:47:08.886 INFO:teuthology.orchestra.run.smithi151.stdout:(53/137): python3-mako-1.0.6-13.el8.noarch.rpm 4.6 MB/s | 157 kB 00:00 2022-03-15T05:47:08.920 INFO:teuthology.orchestra.run.smithi151.stdout:(54/137): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2022-03-15T05:47:08.953 INFO:teuthology.orchestra.run.smithi151.stdout:(55/137): python3-jinja2-2.10.1-3.el8.noarch.rp 2.1 MB/s | 538 kB 00:00 2022-03-15T05:47:09.029 INFO:teuthology.orchestra.run.smithi151.stdout:(56/137): python3-babel-2.5.1-7.el8.noarch.rpm 6.2 MB/s | 4.8 MB 00:00 2022-03-15T05:47:09.054 INFO:teuthology.orchestra.run.smithi151.stdout:(57/137): python3-numpy-f2py-1.14.3-10.el8.x86_ 2.2 MB/s | 225 kB 00:00 2022-03-15T05:47:09.080 INFO:teuthology.orchestra.run.smithi151.stdout:(58/137): python3-prettytable-0.7.2-14.el8.noar 874 kB/s | 44 kB 00:00 2022-03-15T05:47:09.105 INFO:teuthology.orchestra.run.smithi151.stdout:(59/137): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2022-03-15T05:47:09.155 INFO:teuthology.orchestra.run.smithi151.stdout:(60/137): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2022-03-15T05:47:09.180 INFO:teuthology.orchestra.run.smithi151.stdout:(61/137): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2022-03-15T05:47:09.206 INFO:teuthology.orchestra.run.smithi151.stdout:(62/137): python3-pytz-2017.2-9.el8.noarch.rpm 1.1 MB/s | 54 kB 00:00 2022-03-15T05:47:09.290 INFO:teuthology.orchestra.run.smithi151.stdout:(63/137): python3-numpy-1.14.3-10.el8.x86_64.rp 10 MB/s | 3.7 MB 00:00 2022-03-15T05:47:09.327 INFO:teuthology.orchestra.run.smithi151.stdout:(64/137): python3-werkzeug-0.12.2-4.el8.noarch. 3.8 MB/s | 457 kB 00:00 2022-03-15T05:47:09.357 INFO:teuthology.orchestra.run.smithi151.stdout:(65/137): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2022-03-15T05:47:09.382 INFO:teuthology.orchestra.run.smithi151.stdout:(66/137): NetworkManager-initscripts-updown-1.3 2.3 MB/s | 137 kB 00:00 2022-03-15T05:47:09.407 INFO:teuthology.orchestra.run.smithi151.stdout:(67/137): elfutils-libelf-devel-0.186-1.el8.x86 2.4 MB/s | 60 kB 00:00 2022-03-15T05:47:09.455 INFO:teuthology.orchestra.run.smithi151.stdout:(68/137): fuse-2.9.7-12.el8.x86_64.rpm 1.1 MB/s | 82 kB 00:00 2022-03-15T05:47:09.491 INFO:teuthology.orchestra.run.smithi151.stdout:(69/137): keyutils-libs-devel-1.5.10-9.el8.x86_ 1.3 MB/s | 48 kB 00:00 2022-03-15T05:47:09.525 INFO:teuthology.orchestra.run.smithi151.stdout:(70/137): libaio-devel-0.3.112-1.el8.x86_64.rpm 559 kB/s | 19 kB 00:00 2022-03-15T05:47:09.551 INFO:teuthology.orchestra.run.smithi151.stdout:(71/137): libcom_err-devel-1.45.6-2.el8.x86_64. 1.5 MB/s | 38 kB 00:00 2022-03-15T05:47:09.576 INFO:teuthology.orchestra.run.smithi151.stdout:(72/137): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.5 MB/s | 560 kB 00:00 2022-03-15T05:47:09.588 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2022-03-15T05:47:09.591 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2022-03-15T05:47:09.610 INFO:teuthology.orchestra.run.smithi151.stdout:(73/137): libquadmath-8.5.0-10.el8.x86_64.rpm 5.0 MB/s | 171 kB 00:00 2022-03-15T05:47:09.635 INFO:teuthology.orchestra.run.smithi151.stdout:(74/137): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2022-03-15T05:47:09.669 INFO:teuthology.orchestra.run.smithi151.stdout:(75/137): libgfortran-8.5.0-10.el8.x86_64.rpm 5.3 MB/s | 643 kB 00:00 2022-03-15T05:47:09.694 INFO:teuthology.orchestra.run.smithi151.stdout:(76/137): libselinux-devel-2.9-5.el8.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2022-03-15T05:47:09.720 INFO:teuthology.orchestra.run.smithi151.stdout:(77/137): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2022-03-15T05:47:09.745 INFO:teuthology.orchestra.run.smithi151.stdout:(78/137): libuuid-devel-2.32.1-34.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2022-03-15T05:47:09.762 INFO:teuthology.orchestra.run.smithi151.stdout:(79/137): libverto-devel-0.3.0-5.el8.x86_64.rpm 426 kB/s | 18 kB 00:00 2022-03-15T05:47:09.838 INFO:teuthology.orchestra.run.smithi151.stdout:(80/137): pcre2-devel-10.32-2.el8.x86_64.rpm 7.9 MB/s | 605 kB 00:00 2022-03-15T05:47:09.888 INFO:teuthology.orchestra.run.smithi151.stdout:(81/137): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2022-03-15T05:47:09.947 INFO:teuthology.orchestra.run.smithi151.stdout:(82/137): openssl-devel-1.1.1k-5.el8_5.x86_64.r 12 MB/s | 2.3 MB 00:00 2022-03-15T05:47:09.972 INFO:teuthology.orchestra.run.smithi151.stdout:(83/137): pcre2-utf32-10.32-2.el8.x86_64.rpm 2.6 MB/s | 220 kB 00:00 2022-03-15T05:47:10.006 INFO:teuthology.orchestra.run.smithi151.stdout:(84/137): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 237 kB 00:00 2022-03-15T05:47:10.032 INFO:teuthology.orchestra.run.smithi151.stdout:(85/137): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2022-03-15T05:47:10.065 INFO:teuthology.orchestra.run.smithi151.stdout:(86/137): python3-oauthlib-2.1.0-1.el8.noarch.r 4.6 MB/s | 155 kB 00:00 2022-03-15T05:47:10.099 INFO:teuthology.orchestra.run.smithi151.stdout:(87/137): python3-pycparser-2.14-14.el8.noarch. 3.2 MB/s | 109 kB 00:00 2022-03-15T05:47:10.124 INFO:teuthology.orchestra.run.smithi151.stdout:(88/137): python3-cryptography-3.2.1-5.el8.x86_ 3.6 MB/s | 559 kB 00:00 2022-03-15T05:47:10.149 INFO:teuthology.orchestra.run.smithi151.stdout:(89/137): python3-requests-oauthlib-1.0.0-1.el8 849 kB/s | 43 kB 00:00 2022-03-15T05:47:10.175 INFO:teuthology.orchestra.run.smithi151.stdout:(90/137): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2022-03-15T05:47:10.225 INFO:teuthology.orchestra.run.smithi151.stdout:(91/137): zlib-devel-1.2.11-17.el8.x86_64.rpm 762 kB/s | 58 kB 00:00 2022-03-15T05:47:10.485 INFO:teuthology.orchestra.run.smithi151.stdout:(92/137): python3-scipy-1.0.0-21.module_el8.5.0 10 MB/s | 14 MB 00:01 2022-03-15T05:47:10.510 INFO:teuthology.orchestra.run.smithi151.stdout:(93/137): liboath-2.6.2-3.el8.x86_64.rpm 207 kB/s | 59 kB 00:00 2022-03-15T05:47:10.535 INFO:teuthology.orchestra.run.smithi151.stdout:(94/137): gperftools-libs-2.7-9.el8.x86_64.rpm 851 kB/s | 306 kB 00:00 2022-03-15T05:47:10.585 INFO:teuthology.orchestra.run.smithi151.stdout:(95/137): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 872 kB/s | 44 kB 00:00 2022-03-15T05:47:10.686 INFO:teuthology.orchestra.run.smithi151.stdout:(96/137): python3-beautifulsoup4-4.6.3-2.el8.1. 1.8 MB/s | 185 kB 00:00 2022-03-15T05:47:10.911 INFO:teuthology.orchestra.run.smithi151.stdout:(97/137): libunwind-1.3.1-3.el8.x86_64.rpm 176 kB/s | 75 kB 00:00 2022-03-15T05:47:10.937 INFO:teuthology.orchestra.run.smithi151.stdout:(98/137): python3-cachetools-3.1.1-4.el8.noarch 131 kB/s | 33 kB 00:00 2022-03-15T05:47:10.996 INFO:teuthology.orchestra.run.smithi151.stdout:(99/137): python3-asyncssh-2.7.0-2.el8.noarch.r 980 kB/s | 476 kB 00:00 2022-03-15T05:47:11.029 INFO:teuthology.orchestra.run.smithi151.stdout:(100/137): python3-certifi-2018.10.15-7.el8.noa 139 kB/s | 16 kB 00:00 2022-03-15T05:47:11.055 INFO:teuthology.orchestra.run.smithi151.stdout:(101/137): python3-cheroot-8.5.2-1.el8.noarch.r 1.4 MB/s | 173 kB 00:00 2022-03-15T05:47:11.080 INFO:teuthology.orchestra.run.smithi151.stdout:(102/137): python3-cherrypy-18.4.0-1.el8.noarch 4.5 MB/s | 384 kB 00:00 2022-03-15T05:47:11.105 INFO:teuthology.orchestra.run.smithi151.stdout:(103/137): python3-jaraco-6.2-6.el8.noarch.rpm 222 kB/s | 11 kB 00:00 2022-03-15T05:47:11.130 INFO:teuthology.orchestra.run.smithi151.stdout:(104/137): python3-google-auth-1.1.1-10.el8.noa 806 kB/s | 81 kB 00:00 2022-03-15T05:47:11.156 INFO:teuthology.orchestra.run.smithi151.stdout:(105/137): python3-jaraco-functools-2.0-4.el8.n 232 kB/s | 18 kB 00:00 2022-03-15T05:47:11.181 INFO:teuthology.orchestra.run.smithi151.stdout:(106/137): python3-logutils-0.3.5-11.el8.noarch 968 kB/s | 49 kB 00:00 2022-03-15T05:47:11.207 INFO:teuthology.orchestra.run.smithi151.stdout:(107/137): python3-more-itertools-7.2.0-3.el8.n 1.1 MB/s | 59 kB 00:00 2022-03-15T05:47:11.232 INFO:teuthology.orchestra.run.smithi151.stdout:(108/137): python3-natsort-7.1.1-2.el8.noarch.r 1.2 MB/s | 60 kB 00:00 2022-03-15T05:47:11.282 INFO:teuthology.orchestra.run.smithi151.stdout:(109/137): python3-kubernetes-11.0.0-6.el8.noar 6.6 MB/s | 1.2 MB 00:00 2022-03-15T05:47:11.308 INFO:teuthology.orchestra.run.smithi151.stdout:(110/137): python3-pecan-1.3.2-9.el8.noarch.rpm 2.7 MB/s | 283 kB 00:00 2022-03-15T05:47:11.333 INFO:teuthology.orchestra.run.smithi151.stdout:(111/137): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2022-03-15T05:47:11.359 INFO:teuthology.orchestra.run.smithi151.stdout:(112/137): python3-repoze-lru-0.7-6.el8.noarch. 445 kB/s | 34 kB 00:00 2022-03-15T05:47:11.384 INFO:teuthology.orchestra.run.smithi151.stdout:(113/137): python3-routes-2.4.1-12.el8.noarch.r 2.5 MB/s | 196 kB 00:00 2022-03-15T05:47:11.410 INFO:teuthology.orchestra.run.smithi151.stdout:(114/137): python3-rsa-4.8-1.el8.noarch.rpm 808 kB/s | 61 kB 00:00 2022-03-15T05:47:11.435 INFO:teuthology.orchestra.run.smithi151.stdout:(115/137): python3-simplegeneric-0.8.1-17.el8.n 246 kB/s | 19 kB 00:00 2022-03-15T05:47:11.460 INFO:teuthology.orchestra.run.smithi151.stdout:(116/137): python3-singledispatch-3.4.0.3-18.el 316 kB/s | 24 kB 00:00 2022-03-15T05:47:11.485 INFO:teuthology.orchestra.run.smithi151.stdout:(117/137): python3-tempora-1.14.1-5.el8.noarch. 387 kB/s | 29 kB 00:00 2022-03-15T05:47:11.511 INFO:teuthology.orchestra.run.smithi151.stdout:(118/137): python3-trustme-0.6.0-4.el8.noarch.r 365 kB/s | 27 kB 00:00 2022-03-15T05:47:11.537 INFO:teuthology.orchestra.run.smithi151.stdout:(119/137): python3-waitress-1.2.1-2.el8.1.noarc 3.1 MB/s | 241 kB 00:00 2022-03-15T05:47:11.561 INFO:teuthology.orchestra.run.smithi151.stdout:(120/137): python3-websocket-client-0.56.0-5.el 1.2 MB/s | 61 kB 00:00 2022-03-15T05:47:11.587 INFO:teuthology.orchestra.run.smithi151.stdout:(121/137): python3-webob-1.8.5-1.el8.1.noarch.r 2.4 MB/s | 251 kB 00:00 2022-03-15T05:47:11.612 INFO:teuthology.orchestra.run.smithi151.stdout:(122/137): python3-webtest-2.0.33-1.el8.noarch. 1.1 MB/s | 85 kB 00:00 2022-03-15T05:47:11.638 INFO:teuthology.orchestra.run.smithi151.stdout:(123/137): python3-zc-lockfile-2.0-2.el8.noarch 303 kB/s | 23 kB 00:00 2022-03-15T05:47:11.663 INFO:teuthology.orchestra.run.smithi151.stdout:(124/137): xmlstarlet-1.6.1-11.el8.x86_64.rpm 914 kB/s | 69 kB 00:00 2022-03-15T05:47:11.697 INFO:teuthology.orchestra.run.smithi151.stdout:(125/137): NetworkManager-team-1.36.0-2.el8.x86 4.5 MB/s | 152 kB 00:00 2022-03-15T05:47:11.761 INFO:teuthology.orchestra.run.smithi151.stdout:(126/137): NetworkManager-tui-1.36.0-2.el8.x86_ 5.3 MB/s | 345 kB 00:00 2022-03-15T05:47:11.806 INFO:teuthology.orchestra.run.smithi151.stdout:(127/137): iproute-5.15.0-3.el8.x86_64.rpm 18 MB/s | 796 kB 00:00 2022-03-15T05:47:11.839 INFO:teuthology.orchestra.run.smithi151.stdout:(128/137): libblkid-2.32.1-34.el8.x86_64.rpm 6.4 MB/s | 218 kB 00:00 2022-03-15T05:47:11.881 INFO:teuthology.orchestra.run.smithi151.stdout:(129/137): libfdisk-2.32.1-34.el8.x86_64.rpm 5.9 MB/s | 252 kB 00:00 2022-03-15T05:47:11.915 INFO:teuthology.orchestra.run.smithi151.stdout:(130/137): libmount-2.32.1-34.el8.x86_64.rpm 6.9 MB/s | 235 kB 00:00 2022-03-15T05:47:11.949 INFO:teuthology.orchestra.run.smithi151.stdout:(131/137): libsmartcols-2.32.1-34.el8.x86_64.rp 5.2 MB/s | 178 kB 00:00 2022-03-15T05:47:11.982 INFO:teuthology.orchestra.run.smithi151.stdout:(132/137): libuuid-2.32.1-34.el8.x86_64.rpm 2.9 MB/s | 97 kB 00:00 2022-03-15T05:47:12.075 INFO:teuthology.orchestra.run.smithi151.stdout:(133/137): util-linux-2.32.1-34.el8.x86_64.rpm 27 MB/s | 2.5 MB 00:00 2022-03-15T05:47:12.117 INFO:teuthology.orchestra.run.smithi151.stdout:(134/137): NetworkManager-libnm-1.36.0-2.el8.x8 3.8 MB/s | 1.8 MB 00:00 2022-03-15T05:47:12.142 INFO:teuthology.orchestra.run.smithi151.stdout:(135/137): util-linux-user-2.32.1-34.el8.x86_64 1.5 MB/s | 101 kB 00:00 2022-03-15T05:47:12.192 INFO:teuthology.orchestra.run.smithi151.stdout:(136/137): NetworkManager-1.36.0-2.el8.x86_64.r 3.9 MB/s | 2.3 MB 00:00 2022-03-15T05:47:12.217 INFO:teuthology.orchestra.run.smithi151.stdout:(137/137): xfsdump-3.1.8-4.el8.x86_64.rpm 3.2 MB/s | 332 kB 00:00 2022-03-15T05:47:12.221 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2022-03-15T05:47:12.222 INFO:teuthology.orchestra.run.smithi151.stdout:Total 14 MB/s | 191 MB 00:13 2022-03-15T05:47:14.820 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2022-03-15T05:47:14.973 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2022-03-15T05:47:14.995 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2022-03-15T05:47:14.996 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2022-03-15T05:47:15.012 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libuuid-2.32.1-34.el8.x86_64 1/1 2022-03-15T05:47:15.181 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libuuid-2.32.1-34.el8.x86_64 1/150 2022-03-15T05:47:15.256 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libuuid-2.32.1-34.el8.x86_64 1/150 2022-03-15T05:47:15.447 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libblkid-2.32.1-34.el8.x86_64 2/150 2022-03-15T05:47:15.534 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libblkid-2.32.1-34.el8.x86_64 2/150 2022-03-15T05:47:15.694 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/150 2022-03-15T05:47:15.908 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/150 2022-03-15T05:47:16.072 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/150 2022-03-15T05:47:16.444 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2022-03-15T05:47:16.448 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2022-03-15T05:47:16.456 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/150 2022-03-15T05:47:16.664 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados2-2:17.0.0-11109.g1f661216.el8.x86_64 6/150 2022-03-15T05:47:17.094 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:17.0.0-11109.g1f661216.el8.x86_64 6/150 2022-03-15T05:47:17.264 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librbd1-2:17.0.0-11109.g1f661216.el8.x86_64 7/150 2022-03-15T05:47:17.396 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:17.0.0-11109.g1f661216.el8.x86_64 7/150 2022-03-15T05:47:17.755 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:17.0.0-11109.g1f661216.el8.x86_64 8/150 2022-03-15T05:47:17.841 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:17.0.0-11109.g1f661216.el8.x86_64 8/150 2022-03-15T05:47:18.038 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:17.0.0-11109.g1f661216.el8.x86_6 9/150 2022-03-15T05:47:18.205 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 10/150 2022-03-15T05:47:18.638 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 10/150 2022-03-15T05:47:18.814 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:17.0.0-11109.g1f661216.el8.x86_64 11/150 2022-03-15T05:47:18.886 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:17.0.0-11109.g1f661216.el8.x86_64 11/150 2022-03-15T05:47:19.110 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/150 2022-03-15T05:47:19.304 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2022-03-15T05:47:19.480 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:17.0.0-11109.g1f661216.el8.x86_6 14/150 2022-03-15T05:47:19.588 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:17.0.0-11109.g1f661216.el8.x86_6 14/150 2022-03-15T05:47:19.722 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:17.0.0-11109.g1f661216.el8.x8 15/150 2022-03-15T05:47:20.030 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:17.0.0-11109.g1f661216.el8.x8 15/150 2022-03-15T05:47:20.313 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-libnm-1:1.36.0-2.el8.x86_64 16/150 2022-03-15T05:47:20.357 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.36.0-2.el8.x86_64 16/150 2022-03-15T05:47:20.599 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.36.0-2.el8.x86_64 17/150 2022-03-15T05:47:20.844 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-1:1.36.0-2.el8.x86_64 17/150 2022-03-15T05:47:21.179 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.36.0-2.el8.x86_64 17/150 2022-03-15T05:47:21.313 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-2.el8 18/150 2022-03-15T05:47:21.401 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-2.el8 18/150 2022-03-15T05:47:21.583 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2022-03-15T05:47:21.619 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/150 2022-03-15T05:47:21.668 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libuuid-2.32.1-34.el8.x86_64 1/1 2022-03-15T05:47:21.785 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 20/150 2022-03-15T05:47:21.838 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libuuid-2.32.1-34.el8.x86_64 1/150 2022-03-15T05:47:21.955 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libuuid-2.32.1-34.el8.x86_64 1/150 2022-03-15T05:47:21.996 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-8.5.0-10.el8.x86_64 21/150 2022-03-15T05:47:22.122 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libblkid-2.32.1-34.el8.x86_64 2/150 2022-03-15T05:47:22.134 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libquadmath-8.5.0-10.el8.x86_64 21/150 2022-03-15T05:47:22.241 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libblkid-2.32.1-34.el8.x86_64 2/150 2022-03-15T05:47:22.296 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-8.5.0-10.el8.x86_64 22/150 2022-03-15T05:47:22.419 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.2-3.el8.x86_64 3/150 2022-03-15T05:47:22.693 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 4/150 2022-03-15T05:47:22.871 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/150 2022-03-15T05:47:22.883 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libgfortran-8.5.0-10.el8.x86_64 22/150 2022-03-15T05:47:23.163 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.15-3.el8.x86_64 23/150 2022-03-15T05:47:23.340 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/150 2022-03-15T05:47:23.529 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados2-2:17.0.0-11109.g1f661216.el8.x86_64 6/150 2022-03-15T05:47:23.802 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 23/150 2022-03-15T05:47:23.946 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 24/150 2022-03-15T05:47:24.051 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:17.0.0-11109.g1f661216.el8.x86_64 6/150 2022-03-15T05:47:24.239 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librbd1-2:17.0.0-11109.g1f661216.el8.x86_64 7/150 2022-03-15T05:47:24.407 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:17.0.0-11109.g1f661216.el8.x86_64 7/150 2022-03-15T05:47:24.563 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:17.0.0-11109.g1f661216.el8.x86_64 8/150 2022-03-15T05:47:24.631 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 24/150 2022-03-15T05:47:24.699 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:17.0.0-11109.g1f661216.el8.x86_64 8/150 2022-03-15T05:47:24.927 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:17.0.0-11109.g1f661216.el8.x86_6 9/150 2022-03-15T05:47:24.989 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/150 2022-03-15T05:47:25.104 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 10/150 2022-03-15T05:47:25.227 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/150 2022-03-15T05:47:25.450 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/150 2022-03-15T05:47:25.611 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 10/150 2022-03-15T05:47:25.639 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/150 2022-03-15T05:47:25.771 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:17.0.0-11109.g1f661216.el8.x86_64 11/150 2022-03-15T05:47:25.852 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:17.0.0-11109.g1f661216.el8 29/150 2022-03-15T05:47:25.876 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:17.0.0-11109.g1f661216.el8.x86_64 11/150 2022-03-15T05:47:26.022 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:17.0.0-11109.g1f661216.e 30/150 2022-03-15T05:47:26.276 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:17.0.0-11109.g1f661216.el8.x86_ 31/150 2022-03-15T05:47:26.286 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/150 2022-03-15T05:47:26.491 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 13/150 2022-03-15T05:47:26.654 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:17.0.0-11109.g1f661216.el8.x86_6 14/150 2022-03-15T05:47:26.799 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:17.0.0-11109.g1f661216.el8.x86_6 14/150 2022-03-15T05:47:26.954 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:17.0.0-11109.g1f661216.el8.x8 15/150 2022-03-15T05:47:27.244 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/150 2022-03-15T05:47:27.351 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:17.0.0-11109.g1f661216.el8.x8 15/150 2022-03-15T05:47:27.537 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.36.0-2.el8.x86_64 16/150 2022-03-15T05:47:27.620 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/150 2022-03-15T05:47:27.636 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.36.0-2.el8.x86_64 16/150 2022-03-15T05:47:27.926 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/150 2022-03-15T05:47:27.945 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.36.0-2.el8.x86_64 17/150 2022-03-15T05:47:28.104 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2022-03-15T05:47:28.182 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.36.0-2.el8.x86_64 17/150 2022-03-15T05:47:28.626 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.36.0-2.el8.x86_64 17/150 2022-03-15T05:47:28.795 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-2.el8 18/150 2022-03-15T05:47:28.927 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-2.el8 18/150 2022-03-15T05:47:29.152 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 19/150 2022-03-15T05:47:29.328 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 20/150 2022-03-15T05:47:29.545 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-8.5.0-10.el8.x86_64 21/150 2022-03-15T05:47:29.727 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libquadmath-8.5.0-10.el8.x86_64 21/150 2022-03-15T05:47:29.928 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-8.5.0-10.el8.x86_64 22/150 2022-03-15T05:47:30.002 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2022-03-15T05:47:30.324 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/150 2022-03-15T05:47:30.497 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/150 2022-03-15T05:47:30.661 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libgfortran-8.5.0-10.el8.x86_64 22/150 2022-03-15T05:47:30.698 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.8-1.el8.noarch 38/150 2022-03-15T05:47:30.820 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.15-3.el8.x86_64 23/150 2022-03-15T05:47:30.895 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:17.0.0-11109.g1f661216.el8.x86_64 39/150 2022-03-15T05:47:31.107 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:17.0.0-11109.g1f661216.el8.x86_64 40/150 2022-03-15T05:47:31.295 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:17.0.0-11109.g1f661216.el8.x86_ 41/150 2022-03-15T05:47:31.486 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libfdisk-2.32.1-34.el8.x86_64 42/150 2022-03-15T05:47:31.562 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libfdisk-2.32.1-34.el8.x86_64 42/150 2022-03-15T05:47:31.564 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 23/150 2022-03-15T05:47:31.737 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libmount-2.32.1-34.el8.x86_64 43/150 2022-03-15T05:47:31.745 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 24/150 2022-03-15T05:47:31.809 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libmount-2.32.1-34.el8.x86_64 43/150 2022-03-15T05:47:31.990 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.32.1-34.el8.x86_64 44/150 2022-03-15T05:47:32.136 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libsmartcols-2.32.1-34.el8.x86_64 45/150 2022-03-15T05:47:32.585 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libsmartcols-2.32.1-34.el8.x86_64 45/150 2022-03-15T05:47:32.634 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 24/150 2022-03-15T05:47:32.853 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-2.32.1-34.el8.x86_64 46/150 2022-03-15T05:47:32.889 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: util-linux-2.32.1-34.el8.x86_64 46/150 2022-03-15T05:47:33.012 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 25/150 2022-03-15T05:47:33.036 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 47/150 2022-03-15T05:47:33.230 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/150 2022-03-15T05:47:33.231 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/150 2022-03-15T05:47:33.420 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 27/150 2022-03-15T05:47:33.476 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/150 2022-03-15T05:47:33.617 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 28/150 2022-03-15T05:47:33.734 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/150 2022-03-15T05:47:33.786 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:17.0.0-11109.g1f661216.el8 29/150 2022-03-15T05:47:33.890 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 51/150 2022-03-15T05:47:33.948 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:17.0.0-11109.g1f661216.e 30/150 2022-03-15T05:47:34.096 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 52/150 2022-03-15T05:47:34.209 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:17.0.0-11109.g1f661216.el8.x86_ 31/150 2022-03-15T05:47:34.301 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 53/150 2022-03-15T05:47:34.530 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 54/150 2022-03-15T05:47:34.703 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 55/150 2022-03-15T05:47:34.889 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/150 2022-03-15T05:47:35.108 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/150 2022-03-15T05:47:35.297 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/150 2022-03-15T05:47:35.341 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 32/150 2022-03-15T05:47:35.508 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/150 2022-03-15T05:47:35.701 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/150 2022-03-15T05:47:35.734 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 33/150 2022-03-15T05:47:35.892 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/150 2022-03-15T05:47:36.036 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 34/150 2022-03-15T05:47:36.118 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/150 2022-03-15T05:47:36.211 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2022-03-15T05:47:36.342 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/150 2022-03-15T05:47:36.562 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/150 2022-03-15T05:47:36.857 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/150 2022-03-15T05:47:37.086 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/150 2022-03-15T05:47:37.293 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 67/150 2022-03-15T05:47:37.499 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 68/150 2022-03-15T05:47:37.746 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 69/150 2022-03-15T05:47:38.106 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 70/150 2022-03-15T05:47:38.347 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 71/150 2022-03-15T05:47:38.437 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/150 2022-03-15T05:47:38.554 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 72/150 2022-03-15T05:47:38.760 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 36/150 2022-03-15T05:47:38.782 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 73/150 2022-03-15T05:47:38.930 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/150 2022-03-15T05:47:39.048 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 74/150 2022-03-15T05:47:39.099 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.8-1.el8.noarch 38/150 2022-03-15T05:47:39.282 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:17.0.0-11109.g1f661216.el8.x86_64 39/150 2022-03-15T05:47:39.484 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:17.0.0-11109.g1f661216.el8.x86_64 40/150 2022-03-15T05:47:39.680 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:17.0.0-11109.g1f661216.el8.x86_ 41/150 2022-03-15T05:47:39.868 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libfdisk-2.32.1-34.el8.x86_64 42/150 2022-03-15T05:47:39.979 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libfdisk-2.32.1-34.el8.x86_64 42/150 2022-03-15T05:47:40.118 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 75/150 2022-03-15T05:47:40.185 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libmount-2.32.1-34.el8.x86_64 43/150 2022-03-15T05:47:40.288 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libmount-2.32.1-34.el8.x86_64 43/150 2022-03-15T05:47:40.422 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.32.1-34.el8.x86_64 44/150 2022-03-15T05:47:40.494 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 76/150 2022-03-15T05:47:40.577 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libsmartcols-2.32.1-34.el8.x86_64 45/150 2022-03-15T05:47:40.743 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 77/150 2022-03-15T05:47:40.944 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 78/150 2022-03-15T05:47:41.170 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libsmartcols-2.32.1-34.el8.x86_64 45/150 2022-03-15T05:47:41.259 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/150 2022-03-15T05:47:41.520 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 80/150 2022-03-15T05:47:41.713 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 81/150 2022-03-15T05:47:41.827 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : util-linux-2.32.1-34.el8.x86_64 46/150 2022-03-15T05:47:41.913 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: util-linux-2.32.1-34.el8.x86_64 46/150 2022-03-15T05:47:41.929 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 82/150 2022-03-15T05:47:42.079 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 47/150 2022-03-15T05:47:42.193 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 83/150 2022-03-15T05:47:42.237 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 48/150 2022-03-15T05:47:42.412 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 84/150 2022-03-15T05:47:42.495 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 49/150 2022-03-15T05:47:42.548 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 85/150 2022-03-15T05:47:42.719 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 50/150 2022-03-15T05:47:42.857 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 51/150 2022-03-15T05:47:42.867 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 86/150 2022-03-15T05:47:43.032 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 52/150 2022-03-15T05:47:43.097 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 87/150 2022-03-15T05:47:43.227 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 53/150 2022-03-15T05:47:43.272 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcom_err-devel-1.45.6-2.el8.x86_64 88/150 2022-03-15T05:47:43.428 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 54/150 2022-03-15T05:47:43.466 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 89/150 2022-03-15T05:47:43.635 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 55/150 2022-03-15T05:47:43.702 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 90/150 2022-03-15T05:47:43.789 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 56/150 2022-03-15T05:47:43.907 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.7-12.el8.x86_64 91/150 2022-03-15T05:47:43.934 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 57/150 2022-03-15T05:47:44.092 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 92/150 2022-03-15T05:47:44.118 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 58/150 2022-03-15T05:47:44.235 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 93/150 2022-03-15T05:47:44.276 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 59/150 2022-03-15T05:47:44.447 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-2.6-1.el8.noarch 60/150 2022-03-15T05:47:44.625 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 61/150 2022-03-15T05:47:44.902 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 62/150 2022-03-15T05:47:45.145 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 63/150 2022-03-15T05:47:45.336 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 64/150 2022-03-15T05:47:45.661 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 65/150 2022-03-15T05:47:45.913 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 66/150 2022-03-15T05:47:46.084 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 67/150 2022-03-15T05:47:46.281 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 68/150 2022-03-15T05:47:46.532 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 69/150 2022-03-15T05:47:46.940 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 70/150 2022-03-15T05:47:47.260 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 71/150 2022-03-15T05:47:47.426 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 72/150 2022-03-15T05:47:47.665 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 94/150 2022-03-15T05:47:47.677 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 73/150 2022-03-15T05:47:47.876 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 94/150 2022-03-15T05:47:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 74/150 2022-03-15T05:47:48.475 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 94/150 2022-03-15T05:47:48.740 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:17.0.0-11109.g1f661216.el8.x86_64 95/150 2022-03-15T05:47:48.836 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:17.0.0-11109.g1f661216.el8.x86_64 95/150 2022-03-15T05:47:49.000 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:17.0.0-11109.g1f661216.el8.x86_64 96/150 2022-03-15T05:47:49.270 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 75/150 2022-03-15T05:47:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 76/150 2022-03-15T05:47:49.986 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 77/150 2022-03-15T05:47:50.199 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 78/150 2022-03-15T05:47:50.532 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/150 2022-03-15T05:47:50.746 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 80/150 2022-03-15T05:47:50.943 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 81/150 2022-03-15T05:47:51.149 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 82/150 2022-03-15T05:47:51.448 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 83/150 2022-03-15T05:47:51.620 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 84/150 2022-03-15T05:47:51.806 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 85/150 2022-03-15T05:47:52.125 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 86/150 2022-03-15T05:47:52.331 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 87/150 2022-03-15T05:47:52.476 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcom_err-devel-1.45.6-2.el8.x86_64 88/150 2022-03-15T05:47:52.696 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 89/150 2022-03-15T05:47:52.895 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 90/150 2022-03-15T05:47:53.120 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.7-12.el8.x86_64 91/150 2022-03-15T05:47:53.335 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 92/150 2022-03-15T05:47:53.451 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 93/150 2022-03-15T05:47:58.634 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 94/150 2022-03-15T05:47:58.883 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 94/150 2022-03-15T05:47:59.625 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 94/150 2022-03-15T05:47:59.936 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:17.0.0-11109.g1f661216.el8.x86_64 95/150 2022-03-15T05:48:00.087 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:17.0.0-11109.g1f661216.el8.x86_64 95/150 2022-03-15T05:48:00.249 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:17.0.0-11109.g1f661216.el8.x86_64 96/150 2022-03-15T05:48:07.872 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:17.0.0-11109.g1f661216.el8.x86_64 96/150 2022-03-15T05:48:07.873 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2022-03-15T05:48:07.873 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2022-03-15T05:48:07.873 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /dev 2022-03-15T05:48:07.874 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /run 2022-03-15T05:48:07.874 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2022-03-15T05:48:07.874 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2022-03-15T05:48:07.874 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2022-03-15T05:48:07.875 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2022-03-15T05:48:07.875 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /dev 2022-03-15T05:48:07.875 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:08.264 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:17.0.0-11109.g1f661216.el8.noarch 97/150 2022-03-15T05:48:09.759 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:17.0.0-11109.g1f661216.el8.noarch 97/150 2022-03-15T05:48:10.028 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:17.0.0-11109.g1f661216.el8.x86_64 98/150 2022-03-15T05:48:10.251 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:17.0.0-11109.g1f661216.el8.x86_64 98/150 2022-03-15T05:48:10.431 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:17.0.0-11109.g1f661216.el8.x86_64 99/150 2022-03-15T05:48:10.816 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:17.0.0-11109.g1f661216.el8.x86_64 99/150 2022-03-15T05:48:10.980 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:17.0.0-11109.g1f661216.el8.x86_64 100/150 2022-03-15T05:48:11.004 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:17.0.0-11109.g1f661216.el8.x86_64 100/150 2022-03-15T05:48:11.220 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 101/150 2022-03-15T05:48:11.429 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 102/150 2022-03-15T05:48:11.613 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 103/150 2022-03-15T05:48:11.693 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 103/150 2022-03-15T05:48:11.932 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jq-1.6-3.el8.x86_64 104/150 2022-03-15T05:48:12.164 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.1-7.el8.noarch 105/150 2022-03-15T05:48:13.676 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:17.0.0-11109.g1f661216.el8.noarch 106/150 2022-03-15T05:48:13.830 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:17.0.0-11109.g1f661216.el8.noarch 106/150 2022-03-15T05:48:13.977 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-11109.g1f661216. 107/150 2022-03-15T05:48:14.163 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-11109.g1f661216 108/150 2022-03-15T05:48:14.396 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-11109.g1f661216.el8.no 109/150 2022-03-15T05:48:14.605 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-11109.g1f661216.el8.no 109/150 2022-03-15T05:48:14.877 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-11109.g1f661216.el8. 110/150 2022-03-15T05:48:15.838 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-11109.g1f661216.el8. 110/150 2022-03-15T05:48:15.996 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-11109.g1f 111/150 2022-03-15T05:48:16.085 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-11109.g1f 111/150 2022-03-15T05:48:16.439 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-11109.g1f661216.e 112/150 2022-03-15T05:48:16.619 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:17.0.0-11109.g1f661216.el8.x86_64 113/150 2022-03-15T05:48:16.653 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:17.0.0-11109.g1f661216.el8.x86_64 113/150 2022-03-15T05:48:16.821 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:17.0.0-11109.g1f661216.el8.noarc 114/150 2022-03-15T05:48:16.832 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-11109.g1f661216.el8.noarc 114/150 2022-03-15T05:48:17.059 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:17.0.0-11109.g1f661216.el8.x86_64 115/150 2022-03-15T05:48:17.229 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/150 2022-03-15T05:48:21.569 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:17.0.0-11109.g1f661216.el8.x86_64 96/150 2022-03-15T05:48:21.570 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2022-03-15T05:48:21.570 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2022-03-15T05:48:21.571 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2022-03-15T05:48:21.571 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /run 2022-03-15T05:48:21.572 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2022-03-15T05:48:21.572 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2022-03-15T05:48:21.573 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2022-03-15T05:48:21.573 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2022-03-15T05:48:21.573 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2022-03-15T05:48:21.574 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:21.580 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/150 2022-03-15T05:48:21.987 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:17.0.0-11109.g1f661216.el8.noarch 97/150 2022-03-15T05:48:22.763 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:17.0.0-11109.g1f661216.el8.x86_64 117/150 2022-03-15T05:48:22.959 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:17.0.0-11109.g1f661216.el8.x86_64 118/150 2022-03-15T05:48:23.081 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-11109.g1f661216.el8.x86_64 118/150 2022-03-15T05:48:23.262 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-11109.g1f66 119/150 2022-03-15T05:48:23.306 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-11109.g1f66 119/150 2022-03-15T05:48:23.487 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-mirror-2:17.0.0-11109.g1f661216.el8.x86_6 120/150 2022-03-15T05:48:23.723 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:17.0.0-11109.g1f661216.el8.noarch 97/150 2022-03-15T05:48:23.873 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-11109.g1f661216.el8.x86_6 120/150 2022-03-15T05:48:23.915 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:17.0.0-11109.g1f661216.el8.x86_64 98/150 2022-03-15T05:48:24.037 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:17.0.0-11109.g1f661216.el8.x86_64 121/150 2022-03-15T05:48:24.131 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:17.0.0-11109.g1f661216.el8.x86_64 121/150 2022-03-15T05:48:24.218 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:17.0.0-11109.g1f661216.el8.x86_64 98/150 2022-03-15T05:48:24.371 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:17.0.0-11109.g1f661216.el8.x86_64 99/150 2022-03-15T05:48:24.860 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:17.0.0-11109.g1f661216.el8.x86_64 99/150 2022-03-15T05:48:24.978 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 122/150 2022-03-15T05:48:25.062 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:17.0.0-11109.g1f661216.el8.x86_64 100/150 2022-03-15T05:48:25.131 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:17.0.0-11109.g1f661216.el8.x86_64 100/150 2022-03-15T05:48:25.250 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:1.1.1k-5.el8_5.x86_64 123/150 2022-03-15T05:48:25.321 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 101/150 2022-03-15T05:48:25.447 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-user-2.32.1-34.el8.x86_64 124/150 2022-03-15T05:48:25.512 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 102/150 2022-03-15T05:48:25.598 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 125/150 2022-03-15T05:48:25.695 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 103/150 2022-03-15T05:48:25.782 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:17.0.0-11109.g1f661216.el8.x86 126/150 2022-03-15T05:48:25.800 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 103/150 2022-03-15T05:48:26.023 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 127/150 2022-03-15T05:48:26.078 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-3.el8.x86_64 104/150 2022-03-15T05:48:26.198 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-team-1:1.36.0-2.el8.x86_64 128/150 2022-03-15T05:48:26.287 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.1-7.el8.noarch 105/150 2022-03-15T05:48:26.399 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-tui-1:1.36.0-2.el8.x86_64 129/150 2022-03-15T05:48:26.587 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-top-2:17.0.0-11109.g1f661216.el8.noarch 130/150 2022-03-15T05:48:26.828 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 131/150 2022-03-15T05:48:27.062 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:17.0.0-11109.g1f661216.el8.x86_64 132/150 2022-03-15T05:48:27.408 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : xfsdump-3.1.8-4.el8.x86_64 133/150 2022-03-15T05:48:27.679 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : iproute-5.15.0-3.el8.x86_64 134/150 2022-03-15T05:48:27.863 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/150 2022-03-15T05:48:28.069 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/150 2022-03-15T05:48:28.146 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/150 2022-03-15T05:48:28.388 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/150 2022-03-15T05:48:28.400 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/150 2022-03-15T05:48:28.537 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-tui-1:1.36.0-0.4.el8.x86_64 138/150 2022-03-15T05:48:28.671 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : xfsdump-3.1.8-2.el8.x86_64 139/150 2022-03-15T05:48:28.838 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-user-2.32.1-32.el8.x86_64 140/150 2022-03-15T05:48:29.020 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-2.32.1-32.el8.x86_64 141/150 2022-03-15T05:48:29.021 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libfdisk-2.32.1-32.el8.x86_64 142/150 2022-03-15T05:48:29.086 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:17.0.0-11109.g1f661216.el8.noarch 106/150 2022-03-15T05:48:29.259 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:17.0.0-11109.g1f661216.el8.noarch 106/150 2022-03-15T05:48:29.263 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libfdisk-2.32.1-32.el8.x86_64 142/150 2022-03-15T05:48:29.263 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libmount-2.32.1-32.el8.x86_64 143/150 2022-03-15T05:48:29.437 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-11109.g1f661216. 107/150 2022-03-15T05:48:29.454 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libmount-2.32.1-32.el8.x86_64 143/150 2022-03-15T05:48:29.455 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libblkid-2.32.1-32.el8.x86_64 144/150 2022-03-15T05:48:29.627 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-11109.g1f661216 108/150 2022-03-15T05:48:29.679 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libblkid-2.32.1-32.el8.x86_64 144/150 2022-03-15T05:48:29.805 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-team-1:1.36.0-0.4.el8.x86_64 145/150 2022-03-15T05:48:29.811 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-11109.g1f661216.el8.no 109/150 2022-03-15T05:48:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.36.0-0.4.el8.x86_64 146/150 2022-03-15T05:48:29.815 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-1:1.36.0-0.4.el8.x86_64 146/150 2022-03-15T05:48:30.081 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-11109.g1f661216.el8.no 109/150 2022-03-15T05:48:30.810 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-11109.g1f661216.el8. 110/150 2022-03-15T05:48:30.811 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.36.0-0.4.el8.x86_64 146/150 2022-03-15T05:48:30.811 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-libnm-1:1.36.0-0.4.el8.x86_64 147/150 2022-03-15T05:48:30.811 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.36.0-0.4.el8.x86_64 147/150 2022-03-15T05:48:30.812 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libuuid-2.32.1-32.el8.x86_64 148/150 2022-03-15T05:48:30.812 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libuuid-2.32.1-32.el8.x86_64 148/150 2022-03-15T05:48:30.812 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libsmartcols-2.32.1-32.el8.x86_64 149/150 2022-03-15T05:48:30.932 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libsmartcols-2.32.1-32.el8.x86_64 149/150 2022-03-15T05:48:31.093 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : iproute-5.15.0-2.el8.x86_64 150/150 2022-03-15T05:48:31.538 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-11109.g1f661216.el8. 110/150 2022-03-15T05:48:31.695 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: iproute-5.15.0-2.el8.x86_64 150/150 2022-03-15T05:48:31.695 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:17.0.0-11109.g1f661216.el8.x86_64 1/150 2022-03-15T05:48:31.696 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:17.0.0-11109.g1f661216.el8.x86_64 2/150 2022-03-15T05:48:31.696 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 3/150 2022-03-15T05:48:31.696 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 4/150 2022-03-15T05:48:31.696 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-11109.g1f66 5/150 2022-03-15T05:48:31.697 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:17.0.0-11109.g1f661216.el8.x86_64 6/150 2022-03-15T05:48:31.697 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:17.0.0-11109.g1f661216.el8.x86_64 7/150 2022-03-15T05:48:31.697 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:17.0.0-11109.g1f661216.el8.x86_64 8/150 2022-03-15T05:48:31.697 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:17.0.0-11109.g1f661216.el8.x86_64 9/150 2022-03-15T05:48:31.697 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:17.0.0-11109.g1f661216.el8.x86_64 10/150 2022-03-15T05:48:31.698 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:17.0.0-11109.g1f661216.el8.x86_64 11/150 2022-03-15T05:48:31.698 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:17.0.0-11109.g1f661216.el8.x86_64 12/150 2022-03-15T05:48:31.698 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-mirror-2:17.0.0-11109.g1f661216.el8.x86_6 13/150 2022-03-15T05:48:31.698 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:17.0.0-11109.g1f661216.el8.x86 14/150 2022-03-15T05:48:31.698 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:17.0.0-11109.g1f661216.el8.x86_64 15/150 2022-03-15T05:48:31.699 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:17.0.0-11109.g1f661216.el8.x86_6 16/150 2022-03-15T05:48:31.699 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:17.0.0-11109.g1f661216.el8.x86_ 17/150 2022-03-15T05:48:31.699 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:17.0.0-11109.g1f661216.el8.x86_64 18/150 2022-03-15T05:48:31.699 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:17.0.0-11109.g1f661216.el8.x8 19/150 2022-03-15T05:48:31.699 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:17.0.0-11109.g1f661216.el8.x86_64 20/150 2022-03-15T05:48:31.700 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:17.0.0-11109.g1f661216.el8.x86_64 21/150 2022-03-15T05:48:31.700 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:17.0.0-11109.g1f661216.e 22/150 2022-03-15T05:48:31.700 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:17.0.0-11109.g1f661216.el8 23/150 2022-03-15T05:48:31.700 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:17.0.0-11109.g1f661216.el8.x86_ 24/150 2022-03-15T05:48:31.701 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:17.0.0-11109.g1f661216.el8.x86_6 25/150 2022-03-15T05:48:31.701 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:17.0.0-11109.g1f661216.el8.x86_64 26/150 2022-03-15T05:48:31.701 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:17.0.0-11109.g1f661216.el8.x86_64 27/150 2022-03-15T05:48:31.701 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 28/150 2022-03-15T05:48:31.701 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:17.0.0-11109.g1f661216.el8.x86_64 29/150 2022-03-15T05:48:31.702 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:17.0.0-11109.g1f661216.el8.x86_64 30/150 2022-03-15T05:48:31.702 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-11109.g1f661216 31/150 2022-03-15T05:48:31.702 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-11109.g1f661216.el8.no 32/150 2022-03-15T05:48:31.702 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-11109.g1f661216.el8. 33/150 2022-03-15T05:48:31.703 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-11109.g1f 34/150 2022-03-15T05:48:31.703 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-11109.g1f661216.e 35/150 2022-03-15T05:48:31.703 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:17.0.0-11109.g1f661216.el8.noarc 36/150 2022-03-15T05:48:31.703 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-11109.g1f661216. 37/150 2022-03-15T05:48:31.703 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:17.0.0-11109.g1f661216.el8.noarch 38/150 2022-03-15T05:48:31.704 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:17.0.0-11109.g1f661216.el8.noarch 39/150 2022-03-15T05:48:31.704 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-top-2:17.0.0-11109.g1f661216.el8.noarch 40/150 2022-03-15T05:48:31.704 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.1-7.el8.noarch 41/150 2022-03-15T05:48:31.704 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.0.4-10.el8.x86_64 42/150 2022-03-15T05:48:31.705 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.1-9.el8.x86_64 43/150 2022-03-15T05:48:31.705 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jq-1.6-3.el8.x86_64 44/150 2022-03-15T05:48:31.705 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 45/150 2022-03-15T05:48:31.705 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 46/150 2022-03-15T05:48:31.705 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 47/150 2022-03-15T05:48:31.706 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 48/150 2022-03-15T05:48:31.706 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 49/150 2022-03-15T05:48:31.706 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 50/150 2022-03-15T05:48:31.706 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 51/150 2022-03-15T05:48:31.707 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 52/150 2022-03-15T05:48:31.707 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 53/150 2022-03-15T05:48:31.707 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 54/150 2022-03-15T05:48:31.707 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 55/150 2022-03-15T05:48:31.707 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 56/150 2022-03-15T05:48:31.708 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 57/150 2022-03-15T05:48:31.708 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 58/150 2022-03-15T05:48:31.708 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 59/150 2022-03-15T05:48:31.708 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 60/150 2022-03-15T05:48:31.708 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 61/150 2022-03-15T05:48:31.709 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 62/150 2022-03-15T05:48:31.709 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 63/150 2022-03-15T05:48:31.709 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 64/150 2022-03-15T05:48:31.709 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 65/150 2022-03-15T05:48:31.710 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 66/150 2022-03-15T05:48:31.710 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-2.el8 67/150 2022-03-15T05:48:31.710 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 68/150 2022-03-15T05:48:31.710 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 69/150 2022-03-15T05:48:31.710 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 70/150 2022-03-15T05:48:31.711 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 71/150 2022-03-15T05:48:31.711 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/150 2022-03-15T05:48:31.711 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcom_err-devel-1.45.6-2.el8.x86_64 73/150 2022-03-15T05:48:31.711 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-8.5.0-10.el8.x86_64 74/150 2022-03-15T05:48:31.712 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-8.5.0-10.el8.x86_64 75/150 2022-03-15T05:48:31.712 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 76/150 2022-03-15T05:48:31.712 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 77/150 2022-03-15T05:48:31.712 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 78/150 2022-03-15T05:48:31.712 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.32.1-34.el8.x86_64 79/150 2022-03-15T05:48:31.713 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/150 2022-03-15T05:48:31.713 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:1.1.1k-5.el8_5.x86_64 81/150 2022-03-15T05:48:31.713 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 82/150 2022-03-15T05:48:31.713 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 83/150 2022-03-15T05:48:31.714 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 84/150 2022-03-15T05:48:31.714 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 85/150 2022-03-15T05:48:31.714 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 86/150 2022-03-15T05:48:31.714 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 87/150 2022-03-15T05:48:31.715 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 88/150 2022-03-15T05:48:31.715 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 89/150 2022-03-15T05:48:31.715 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 90/150 2022-03-15T05:48:31.715 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 91/150 2022-03-15T05:48:31.715 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 92/150 2022-03-15T05:48:31.716 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 93/150 2022-03-15T05:48:31.716 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 94/150 2022-03-15T05:48:31.716 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 95/150 2022-03-15T05:48:31.716 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 96/150 2022-03-15T05:48:31.717 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 97/150 2022-03-15T05:48:31.717 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/150 2022-03-15T05:48:31.717 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 99/150 2022-03-15T05:48:31.717 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 100/150 2022-03-15T05:48:31.717 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 101/150 2022-03-15T05:48:31.718 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 102/150 2022-03-15T05:48:31.718 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 103/150 2022-03-15T05:48:31.718 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 104/150 2022-03-15T05:48:31.718 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 105/150 2022-03-15T05:48:31.719 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 106/150 2022-03-15T05:48:31.719 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 107/150 2022-03-15T05:48:31.719 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 108/150 2022-03-15T05:48:31.719 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 109/150 2022-03-15T05:48:31.719 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 110/150 2022-03-15T05:48:31.720 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-2.6-1.el8.noarch 111/150 2022-03-15T05:48:31.720 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 112/150 2022-03-15T05:48:31.720 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 113/150 2022-03-15T05:48:31.720 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 114/150 2022-03-15T05:48:31.721 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 115/150 2022-03-15T05:48:31.721 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 116/150 2022-03-15T05:48:31.721 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 117/150 2022-03-15T05:48:31.721 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 118/150 2022-03-15T05:48:31.722 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 119/150 2022-03-15T05:48:31.722 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 120/150 2022-03-15T05:48:31.722 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 121/150 2022-03-15T05:48:31.722 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 122/150 2022-03-15T05:48:31.722 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 123/150 2022-03-15T05:48:31.723 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 124/150 2022-03-15T05:48:31.723 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.36.0-2.el8.x86_64 125/150 2022-03-15T05:48:31.723 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.36.0-0.4.el8.x86_64 126/150 2022-03-15T05:48:31.723 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.36.0-2.el8.x86_64 127/150 2022-03-15T05:48:31.724 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.36.0-0.4.el8.x86_64 128/150 2022-03-15T05:48:31.724 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.36.0-2.el8.x86_64 129/150 2022-03-15T05:48:31.724 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.36.0-0.4.el8.x86_64 130/150 2022-03-15T05:48:31.724 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.36.0-2.el8.x86_64 131/150 2022-03-15T05:48:31.724 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.36.0-0.4.el8.x86_64 132/150 2022-03-15T05:48:31.725 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : iproute-5.15.0-3.el8.x86_64 133/150 2022-03-15T05:48:31.725 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : iproute-5.15.0-2.el8.x86_64 134/150 2022-03-15T05:48:31.725 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libblkid-2.32.1-34.el8.x86_64 135/150 2022-03-15T05:48:31.726 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libblkid-2.32.1-32.el8.x86_64 136/150 2022-03-15T05:48:31.726 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfdisk-2.32.1-34.el8.x86_64 137/150 2022-03-15T05:48:31.726 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfdisk-2.32.1-32.el8.x86_64 138/150 2022-03-15T05:48:31.726 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libmount-2.32.1-34.el8.x86_64 139/150 2022-03-15T05:48:31.727 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libmount-2.32.1-32.el8.x86_64 140/150 2022-03-15T05:48:31.727 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsmartcols-2.32.1-34.el8.x86_64 141/150 2022-03-15T05:48:31.727 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsmartcols-2.32.1-32.el8.x86_64 142/150 2022-03-15T05:48:31.727 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-2.32.1-34.el8.x86_64 143/150 2022-03-15T05:48:31.728 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-2.32.1-32.el8.x86_64 144/150 2022-03-15T05:48:31.728 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-2.32.1-34.el8.x86_64 145/150 2022-03-15T05:48:31.728 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-2.32.1-32.el8.x86_64 146/150 2022-03-15T05:48:31.728 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-user-2.32.1-34.el8.x86_64 147/150 2022-03-15T05:48:31.729 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-user-2.32.1-32.el8.x86_64 148/150 2022-03-15T05:48:31.729 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 149/150 2022-03-15T05:48:31.730 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-11109.g1f 111/150 2022-03-15T05:48:31.867 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-11109.g1f 111/150 2022-03-15T05:48:32.246 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-11109.g1f661216.e 112/150 2022-03-15T05:48:32.431 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:17.0.0-11109.g1f661216.el8.x86_64 113/150 2022-03-15T05:48:32.516 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:17.0.0-11109.g1f661216.el8.x86_64 113/150 2022-03-15T05:48:32.744 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:17.0.0-11109.g1f661216.el8.noarc 114/150 2022-03-15T05:48:32.787 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-11109.g1f661216.el8.noarc 114/150 2022-03-15T05:48:33.022 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:17.0.0-11109.g1f661216.el8.x86_64 115/150 2022-03-15T05:48:33.152 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/150 2022-03-15T05:48:33.552 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsdump-3.1.8-2.el8.x86_64 150/150 2022-03-15T05:48:33.553 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:33.553 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2022-03-15T05:48:33.553 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-1:1.36.0-2.el8.x86_64 2022-03-15T05:48:33.554 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm-1:1.36.0-2.el8.x86_64 2022-03-15T05:48:33.554 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team-1:1.36.0-2.el8.x86_64 2022-03-15T05:48:33.554 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui-1:1.36.0-2.el8.x86_64 2022-03-15T05:48:33.554 INFO:teuthology.orchestra.run.smithi164.stdout: iproute-5.15.0-3.el8.x86_64 2022-03-15T05:48:33.555 INFO:teuthology.orchestra.run.smithi164.stdout: libblkid-2.32.1-34.el8.x86_64 2022-03-15T05:48:33.555 INFO:teuthology.orchestra.run.smithi164.stdout: libfdisk-2.32.1-34.el8.x86_64 2022-03-15T05:48:33.555 INFO:teuthology.orchestra.run.smithi164.stdout: libmount-2.32.1-34.el8.x86_64 2022-03-15T05:48:33.555 INFO:teuthology.orchestra.run.smithi164.stdout: libsmartcols-2.32.1-34.el8.x86_64 2022-03-15T05:48:33.556 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-2.32.1-34.el8.x86_64 2022-03-15T05:48:33.556 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-2.32.1-34.el8.x86_64 2022-03-15T05:48:33.556 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-user-2.32.1-34.el8.x86_64 2022-03-15T05:48:33.556 INFO:teuthology.orchestra.run.smithi164.stdout: xfsdump-3.1.8-4.el8.x86_64 2022-03-15T05:48:33.557 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2022-03-15T05:48:33.557 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-initscripts-updown-1:1.36.0-2.el8.noarch 2022-03-15T05:48:33.557 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.1-7.el8.noarch 2022-03-15T05:48:33.557 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.0.4-10.el8.x86_64 2022-03-15T05:48:33.557 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.558 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.558 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.558 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.558 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:33.558 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.559 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.559 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.559 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:33.559 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.560 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.561 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:33.562 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-03-15T05:48:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.1-9.el8.x86_64 2022-03-15T05:48:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.7-12.el8.x86_64 2022-03-15T05:48:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-03-15T05:48:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: jq-1.6-3.el8.x86_64 2022-03-15T05:48:33.563 INFO:teuthology.orchestra.run.smithi164.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-03-15T05:48:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-03-15T05:48:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-03-15T05:48:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.564 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: libcom_err-devel-1.45.6-2.el8.x86_64 2022-03-15T05:48:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-8.5.0-10.el8.x86_64 2022-03-15T05:48:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.2-3.el8.x86_64 2022-03-15T05:48:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-8.5.0-10.el8.x86_64 2022-03-15T05:48:33.565 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-03-15T05:48:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.566 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-03-15T05:48:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-03-15T05:48:33.567 INFO:teuthology.orchestra.run.smithi164.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-03-15T05:48:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-25.el8.x86_64 2022-03-15T05:48:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.3.1-3.el8.x86_64 2022-03-15T05:48:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.32.1-34.el8.x86_64 2022-03-15T05:48:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-03-15T05:48:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-03-15T05:48:33.568 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-03-15T05:48:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.15-3.el8.x86_64 2022-03-15T05:48:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-03-15T05:48:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:1.1.1k-5.el8_5.x86_64 2022-03-15T05:48:33.569 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-03-15T05:48:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-03-15T05:48:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-03-15T05:48:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-03-15T05:48:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.5.1-7.el8.noarch 2022-03-15T05:48:33.570 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-03-15T05:48:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-03-15T05:48:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-03-15T05:48:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.571 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-03-15T05:48:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-03-15T05:48:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-03-15T05:48:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-03-15T05:48:33.572 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-03-15T05:48:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-03-15T05:48:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-6.2-6.el8.noarch 2022-03-15T05:48:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-03-15T05:48:33.573 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-03-15T05:48:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-03-15T05:48:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-03-15T05:48:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-03-15T05:48:33.574 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-03-15T05:48:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-03-15T05:48:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.0.6-13.el8.noarch 2022-03-15T05:48:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-03-15T05:48:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-03-15T05:48:33.575 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-03-15T05:48:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-03-15T05:48:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-03-15T05:48:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-03-15T05:48:33.576 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-03-15T05:48:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-2.6-1.el8.noarch 2022-03-15T05:48:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-03-15T05:48:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-03-15T05:48:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-03-15T05:48:33.577 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-03-15T05:48:33.578 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.14-14.el8.noarch 2022-03-15T05:48:33.578 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2017.2-9.el8.noarch 2022-03-15T05:48:33.578 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.578 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.579 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-03-15T05:48:33.579 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-03-15T05:48:33.579 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.579 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.4.1-12.el8.noarch 2022-03-15T05:48:33.579 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.8-1.el8.noarch 2022-03-15T05:48:33.580 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-03-15T05:48:33.580 INFO:teuthology.orchestra.run.smithi164.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-03-15T05:48:33.580 INFO:teuthology.orchestra.run.smithi164.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-03-15T05:48:33.580 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-03-15T05:48:33.580 INFO:teuthology.orchestra.run.smithi164.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-03-15T05:48:33.581 INFO:teuthology.orchestra.run.smithi164.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-03-15T05:48:33.581 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-03-15T05:48:33.581 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-03-15T05:48:33.581 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-03-15T05:48:33.581 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-03-15T05:48:33.582 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-03-15T05:48:33.582 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.582 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.582 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:33.583 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-1.el8.x86_64 2022-03-15T05:48:33.583 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-03-15T05:48:33.583 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-03-15T05:48:33.584 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-03-15T05:48:33.584 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:33.584 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2022-03-15T05:48:33.757 DEBUG:teuthology.parallel:result is None 2022-03-15T05:48:38.195 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/150 2022-03-15T05:48:39.470 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:17.0.0-11109.g1f661216.el8.x86_64 117/150 2022-03-15T05:48:39.721 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:17.0.0-11109.g1f661216.el8.x86_64 118/150 2022-03-15T05:48:39.871 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-11109.g1f661216.el8.x86_64 118/150 2022-03-15T05:48:40.035 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-11109.g1f66 119/150 2022-03-15T05:48:40.128 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-11109.g1f66 119/150 2022-03-15T05:48:40.310 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:17.0.0-11109.g1f661216.el8.x86_6 120/150 2022-03-15T05:48:40.804 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:17.0.0-11109.g1f661216.el8.x86_6 120/150 2022-03-15T05:48:40.993 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:17.0.0-11109.g1f661216.el8.x86_64 121/150 2022-03-15T05:48:41.144 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:17.0.0-11109.g1f661216.el8.x86_64 121/150 2022-03-15T05:48:42.475 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 122/150 2022-03-15T05:48:42.784 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:1.1.1k-5.el8_5.x86_64 123/150 2022-03-15T05:48:42.966 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : util-linux-user-2.32.1-34.el8.x86_64 124/150 2022-03-15T05:48:43.130 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 125/150 2022-03-15T05:48:43.315 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:17.0.0-11109.g1f661216.el8.x86 126/150 2022-03-15T05:48:43.529 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 127/150 2022-03-15T05:48:43.726 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.36.0-2.el8.x86_64 128/150 2022-03-15T05:48:43.890 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.36.0-2.el8.x86_64 129/150 2022-03-15T05:48:44.087 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:17.0.0-11109.g1f661216.el8.noarch 130/150 2022-03-15T05:48:44.295 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 131/150 2022-03-15T05:48:44.563 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:17.0.0-11109.g1f661216.el8.x86_64 132/150 2022-03-15T05:48:44.934 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : xfsdump-3.1.8-4.el8.x86_64 133/150 2022-03-15T05:48:45.185 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : iproute-5.15.0-3.el8.x86_64 134/150 2022-03-15T05:48:45.362 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 135/150 2022-03-15T05:48:45.525 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.1-9.el8.x86_64 136/150 2022-03-15T05:48:45.644 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 136/150 2022-03-15T05:48:45.909 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.0.4-10.el8.x86_64 137/150 2022-03-15T05:48:45.950 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 137/150 2022-03-15T05:48:46.077 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.36.0-0.4.el8.x86_64 138/150 2022-03-15T05:48:46.210 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : xfsdump-3.1.8-2.el8.x86_64 139/150 2022-03-15T05:48:46.386 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : util-linux-user-2.32.1-32.el8.x86_64 140/150 2022-03-15T05:48:46.610 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : util-linux-2.32.1-32.el8.x86_64 141/150 2022-03-15T05:48:46.611 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libfdisk-2.32.1-32.el8.x86_64 142/150 2022-03-15T05:48:46.845 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libfdisk-2.32.1-32.el8.x86_64 142/150 2022-03-15T05:48:46.845 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libmount-2.32.1-32.el8.x86_64 143/150 2022-03-15T05:48:47.103 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libmount-2.32.1-32.el8.x86_64 143/150 2022-03-15T05:48:47.104 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libblkid-2.32.1-32.el8.x86_64 144/150 2022-03-15T05:48:47.369 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libblkid-2.32.1-32.el8.x86_64 144/150 2022-03-15T05:48:47.503 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.36.0-0.4.el8.x86_64 145/150 2022-03-15T05:48:47.537 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.36.0-0.4.el8.x86_64 146/150 2022-03-15T05:48:47.538 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.36.0-0.4.el8.x86_64 146/150 2022-03-15T05:48:48.305 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.36.0-0.4.el8.x86_64 146/150 2022-03-15T05:48:48.305 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.36.0-0.4.el8.x86_64 147/150 2022-03-15T05:48:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.36.0-0.4.el8.x86_64 147/150 2022-03-15T05:48:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libuuid-2.32.1-32.el8.x86_64 148/150 2022-03-15T05:48:48.786 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libuuid-2.32.1-32.el8.x86_64 148/150 2022-03-15T05:48:48.787 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libsmartcols-2.32.1-32.el8.x86_64 149/150 2022-03-15T05:48:49.016 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libsmartcols-2.32.1-32.el8.x86_64 149/150 2022-03-15T05:48:49.167 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : iproute-5.15.0-2.el8.x86_64 150/150 2022-03-15T05:48:49.464 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: iproute-5.15.0-2.el8.x86_64 150/150 2022-03-15T05:48:49.465 INFO:teuthology.orchestra.run.smithi151.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2022-03-15T05:48:49.465 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:50.374 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:17.0.0-11109.g1f661216.el8.x86_64 1/150 2022-03-15T05:48:50.374 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:17.0.0-11109.g1f661216.el8.x86_64 2/150 2022-03-15T05:48:50.374 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 3/150 2022-03-15T05:48:50.375 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 4/150 2022-03-15T05:48:50.375 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-11109.g1f66 5/150 2022-03-15T05:48:50.375 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:17.0.0-11109.g1f661216.el8.x86_64 6/150 2022-03-15T05:48:50.375 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:17.0.0-11109.g1f661216.el8.x86_64 7/150 2022-03-15T05:48:50.376 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:17.0.0-11109.g1f661216.el8.x86_64 8/150 2022-03-15T05:48:50.376 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:17.0.0-11109.g1f661216.el8.x86_64 9/150 2022-03-15T05:48:50.376 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:17.0.0-11109.g1f661216.el8.x86_64 10/150 2022-03-15T05:48:50.376 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:17.0.0-11109.g1f661216.el8.x86_64 11/150 2022-03-15T05:48:50.377 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:17.0.0-11109.g1f661216.el8.x86_64 12/150 2022-03-15T05:48:50.377 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:17.0.0-11109.g1f661216.el8.x86_6 13/150 2022-03-15T05:48:50.377 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:17.0.0-11109.g1f661216.el8.x86 14/150 2022-03-15T05:48:50.377 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:17.0.0-11109.g1f661216.el8.x86_64 15/150 2022-03-15T05:48:50.377 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:17.0.0-11109.g1f661216.el8.x86_6 16/150 2022-03-15T05:48:50.378 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:17.0.0-11109.g1f661216.el8.x86_ 17/150 2022-03-15T05:48:50.378 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:17.0.0-11109.g1f661216.el8.x86_64 18/150 2022-03-15T05:48:50.378 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:17.0.0-11109.g1f661216.el8.x8 19/150 2022-03-15T05:48:50.378 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:17.0.0-11109.g1f661216.el8.x86_64 20/150 2022-03-15T05:48:50.379 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:17.0.0-11109.g1f661216.el8.x86_64 21/150 2022-03-15T05:48:50.379 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:17.0.0-11109.g1f661216.e 22/150 2022-03-15T05:48:50.379 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:17.0.0-11109.g1f661216.el8 23/150 2022-03-15T05:48:50.379 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:17.0.0-11109.g1f661216.el8.x86_ 24/150 2022-03-15T05:48:50.380 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:17.0.0-11109.g1f661216.el8.x86_6 25/150 2022-03-15T05:48:50.380 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:17.0.0-11109.g1f661216.el8.x86_64 26/150 2022-03-15T05:48:50.380 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:17.0.0-11109.g1f661216.el8.x86_64 27/150 2022-03-15T05:48:50.392 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 28/150 2022-03-15T05:48:50.393 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:17.0.0-11109.g1f661216.el8.x86_64 29/150 2022-03-15T05:48:50.393 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:17.0.0-11109.g1f661216.el8.x86_64 30/150 2022-03-15T05:48:50.393 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-11109.g1f661216 31/150 2022-03-15T05:48:50.393 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-11109.g1f661216.el8.no 32/150 2022-03-15T05:48:50.394 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-11109.g1f661216.el8. 33/150 2022-03-15T05:48:50.394 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-11109.g1f 34/150 2022-03-15T05:48:50.394 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-11109.g1f661216.e 35/150 2022-03-15T05:48:50.394 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:17.0.0-11109.g1f661216.el8.noarc 36/150 2022-03-15T05:48:50.394 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-11109.g1f661216. 37/150 2022-03-15T05:48:50.395 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:17.0.0-11109.g1f661216.el8.noarch 38/150 2022-03-15T05:48:50.395 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:17.0.0-11109.g1f661216.el8.noarch 39/150 2022-03-15T05:48:50.395 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:17.0.0-11109.g1f661216.el8.noarch 40/150 2022-03-15T05:48:50.395 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.1-7.el8.noarch 41/150 2022-03-15T05:48:50.396 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.0.4-10.el8.x86_64 42/150 2022-03-15T05:48:50.396 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.1-9.el8.x86_64 43/150 2022-03-15T05:48:50.396 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-3.el8.x86_64 44/150 2022-03-15T05:48:50.396 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 45/150 2022-03-15T05:48:50.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 46/150 2022-03-15T05:48:50.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 47/150 2022-03-15T05:48:50.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 48/150 2022-03-15T05:48:50.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 49/150 2022-03-15T05:48:50.397 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 50/150 2022-03-15T05:48:50.398 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 51/150 2022-03-15T05:48:50.398 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 52/150 2022-03-15T05:48:50.398 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 53/150 2022-03-15T05:48:50.398 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 54/150 2022-03-15T05:48:50.399 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 55/150 2022-03-15T05:48:50.399 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 56/150 2022-03-15T05:48:50.399 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 57/150 2022-03-15T05:48:50.399 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 58/150 2022-03-15T05:48:50.400 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 59/150 2022-03-15T05:48:50.400 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 60/150 2022-03-15T05:48:50.400 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 61/150 2022-03-15T05:48:50.400 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 62/150 2022-03-15T05:48:50.400 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 63/150 2022-03-15T05:48:50.401 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a2 64/150 2022-03-15T05:48:50.401 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 65/150 2022-03-15T05:48:50.401 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 66/150 2022-03-15T05:48:50.401 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-2.el8 67/150 2022-03-15T05:48:50.402 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 68/150 2022-03-15T05:48:50.402 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 69/150 2022-03-15T05:48:50.402 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 70/150 2022-03-15T05:48:50.402 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 71/150 2022-03-15T05:48:50.402 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/150 2022-03-15T05:48:50.403 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcom_err-devel-1.45.6-2.el8.x86_64 73/150 2022-03-15T05:48:50.403 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-8.5.0-10.el8.x86_64 74/150 2022-03-15T05:48:50.403 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-8.5.0-10.el8.x86_64 75/150 2022-03-15T05:48:50.403 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 76/150 2022-03-15T05:48:50.404 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 77/150 2022-03-15T05:48:50.404 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 78/150 2022-03-15T05:48:50.404 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.32.1-34.el8.x86_64 79/150 2022-03-15T05:48:50.404 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/150 2022-03-15T05:48:50.405 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:1.1.1k-5.el8_5.x86_64 81/150 2022-03-15T05:48:50.405 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 82/150 2022-03-15T05:48:50.405 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 83/150 2022-03-15T05:48:50.405 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 84/150 2022-03-15T05:48:50.405 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 85/150 2022-03-15T05:48:50.406 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 86/150 2022-03-15T05:48:50.406 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 87/150 2022-03-15T05:48:50.406 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 88/150 2022-03-15T05:48:50.406 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 89/150 2022-03-15T05:48:50.407 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 90/150 2022-03-15T05:48:50.407 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 91/150 2022-03-15T05:48:50.407 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 92/150 2022-03-15T05:48:50.407 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 93/150 2022-03-15T05:48:50.407 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 94/150 2022-03-15T05:48:50.408 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 95/150 2022-03-15T05:48:50.408 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 96/150 2022-03-15T05:48:50.408 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 97/150 2022-03-15T05:48:50.408 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 98/150 2022-03-15T05:48:50.409 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 99/150 2022-03-15T05:48:50.409 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 100/150 2022-03-15T05:48:50.409 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 101/150 2022-03-15T05:48:50.409 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 102/150 2022-03-15T05:48:50.409 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 103/150 2022-03-15T05:48:50.410 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 104/150 2022-03-15T05:48:50.410 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 105/150 2022-03-15T05:48:50.410 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 106/150 2022-03-15T05:48:50.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 107/150 2022-03-15T05:48:50.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 108/150 2022-03-15T05:48:50.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 109/150 2022-03-15T05:48:50.411 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 110/150 2022-03-15T05:48:50.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-2.6-1.el8.noarch 111/150 2022-03-15T05:48:50.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 112/150 2022-03-15T05:48:50.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 113/150 2022-03-15T05:48:50.412 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 114/150 2022-03-15T05:48:50.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 115/150 2022-03-15T05:48:50.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 116/150 2022-03-15T05:48:50.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 117/150 2022-03-15T05:48:50.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 118/150 2022-03-15T05:48:50.413 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 119/150 2022-03-15T05:48:50.414 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 120/150 2022-03-15T05:48:50.414 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 121/150 2022-03-15T05:48:50.414 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 122/150 2022-03-15T05:48:50.414 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 123/150 2022-03-15T05:48:50.415 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 124/150 2022-03-15T05:48:50.415 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.36.0-2.el8.x86_64 125/150 2022-03-15T05:48:50.415 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.36.0-0.4.el8.x86_64 126/150 2022-03-15T05:48:50.415 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.36.0-2.el8.x86_64 127/150 2022-03-15T05:48:50.416 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.36.0-0.4.el8.x86_64 128/150 2022-03-15T05:48:50.416 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.36.0-2.el8.x86_64 129/150 2022-03-15T05:48:50.416 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.36.0-0.4.el8.x86_64 130/150 2022-03-15T05:48:50.416 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.36.0-2.el8.x86_64 131/150 2022-03-15T05:48:50.416 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.36.0-0.4.el8.x86_64 132/150 2022-03-15T05:48:50.417 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : iproute-5.15.0-3.el8.x86_64 133/150 2022-03-15T05:48:50.417 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : iproute-5.15.0-2.el8.x86_64 134/150 2022-03-15T05:48:50.417 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libblkid-2.32.1-34.el8.x86_64 135/150 2022-03-15T05:48:50.417 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libblkid-2.32.1-32.el8.x86_64 136/150 2022-03-15T05:48:50.418 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libfdisk-2.32.1-34.el8.x86_64 137/150 2022-03-15T05:48:50.418 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libfdisk-2.32.1-32.el8.x86_64 138/150 2022-03-15T05:48:50.418 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libmount-2.32.1-34.el8.x86_64 139/150 2022-03-15T05:48:50.418 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libmount-2.32.1-32.el8.x86_64 140/150 2022-03-15T05:48:50.419 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsmartcols-2.32.1-34.el8.x86_64 141/150 2022-03-15T05:48:50.419 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsmartcols-2.32.1-32.el8.x86_64 142/150 2022-03-15T05:48:50.419 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-2.32.1-34.el8.x86_64 143/150 2022-03-15T05:48:50.419 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-2.32.1-32.el8.x86_64 144/150 2022-03-15T05:48:50.420 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : util-linux-2.32.1-34.el8.x86_64 145/150 2022-03-15T05:48:50.420 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : util-linux-2.32.1-32.el8.x86_64 146/150 2022-03-15T05:48:50.420 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : util-linux-user-2.32.1-34.el8.x86_64 147/150 2022-03-15T05:48:50.420 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : util-linux-user-2.32.1-32.el8.x86_64 148/150 2022-03-15T05:48:50.420 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 149/150 2022-03-15T05:48:52.210 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.8-2.el8.x86_64 150/150 2022-03-15T05:48:52.211 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:52.211 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2022-03-15T05:48:52.211 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.36.0-2.el8.x86_64 2022-03-15T05:48:52.212 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.36.0-2.el8.x86_64 2022-03-15T05:48:52.212 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.36.0-2.el8.x86_64 2022-03-15T05:48:52.212 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.36.0-2.el8.x86_64 2022-03-15T05:48:52.212 INFO:teuthology.orchestra.run.smithi151.stdout: iproute-5.15.0-3.el8.x86_64 2022-03-15T05:48:52.212 INFO:teuthology.orchestra.run.smithi151.stdout: libblkid-2.32.1-34.el8.x86_64 2022-03-15T05:48:52.213 INFO:teuthology.orchestra.run.smithi151.stdout: libfdisk-2.32.1-34.el8.x86_64 2022-03-15T05:48:52.213 INFO:teuthology.orchestra.run.smithi151.stdout: libmount-2.32.1-34.el8.x86_64 2022-03-15T05:48:52.213 INFO:teuthology.orchestra.run.smithi151.stdout: libsmartcols-2.32.1-34.el8.x86_64 2022-03-15T05:48:52.213 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-2.32.1-34.el8.x86_64 2022-03-15T05:48:52.214 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux-2.32.1-34.el8.x86_64 2022-03-15T05:48:52.214 INFO:teuthology.orchestra.run.smithi151.stdout: util-linux-user-2.32.1-34.el8.x86_64 2022-03-15T05:48:52.214 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump-3.1.8-4.el8.x86_64 2022-03-15T05:48:52.214 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2022-03-15T05:48:52.215 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-initscripts-updown-1:1.36.0-2.el8.noarch 2022-03-15T05:48:52.215 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.1-7.el8.noarch 2022-03-15T05:48:52.215 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.0.4-10.el8.x86_64 2022-03-15T05:48:52.215 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.216 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.216 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.216 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.216 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:52.217 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.217 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.217 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.218 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:52.218 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:52.218 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:52.218 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:52.219 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:52.219 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.219 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.219 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:52.220 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.220 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.220 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.220 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:52.220 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:52.221 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.221 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:17.0.0-11109.g1f661216.el8.noarch 2022-03-15T05:48:52.221 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2022-03-15T05:48:52.222 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.1-9.el8.x86_64 2022-03-15T05:48:52.222 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.7-12.el8.x86_64 2022-03-15T05:48:52.222 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2022-03-15T05:48:52.222 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-3.el8.x86_64 2022-03-15T05:48:52.223 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2022-03-15T05:48:52.223 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel-1.18.2-14.el8.x86_64 2022-03-15T05:48:52.223 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.112-1.el8.x86_64 2022-03-15T05:48:52.223 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.224 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.224 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.224 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel-1.45.6-2.el8.x86_64 2022-03-15T05:48:52.225 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-8.5.0-10.el8.x86_64 2022-03-15T05:48:52.225 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.2-3.el8.x86_64 2022-03-15T05:48:52.225 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-8.5.0-10.el8.x86_64 2022-03-15T05:48:52.225 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.9.0-3.el8.x86_64 2022-03-15T05:48:52.225 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.226 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.226 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.226 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.226 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-0.11.4-3.el8.x86_64 2022-03-15T05:48:52.227 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.227 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel-2.9-5.el8.x86_64 2022-03-15T05:48:52.227 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel-2.9-3.el8.x86_64 2022-03-15T05:48:52.227 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-25.el8.x86_64 2022-03-15T05:48:52.228 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.3.1-3.el8.x86_64 2022-03-15T05:48:52.228 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.32.1-34.el8.x86_64 2022-03-15T05:48:52.228 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel-0.3.0-5.el8.x86_64 2022-03-15T05:48:52.228 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.8.1-11.el8.x86_64 2022-03-15T05:48:52.229 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.8.2-2.el8.x86_64 2022-03-15T05:48:52.229 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.15-3.el8.x86_64 2022-03-15T05:48:52.229 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads-0.3.15-3.el8.x86_64 2022-03-15T05:48:52.229 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:1.1.1k-5.el8_5.x86_64 2022-03-15T05:48:52.229 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel-10.32-2.el8.x86_64 2022-03-15T05:48:52.230 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16-10.32-2.el8.x86_64 2022-03-15T05:48:52.230 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32-10.32-2.el8.x86_64 2022-03-15T05:48:52.230 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2022-03-15T05:48:52.230 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.5.1-7.el8.noarch 2022-03-15T05:48:52.231 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2022-03-15T05:48:52.231 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2022-03-15T05:48:52.231 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-3.1.1-4.el8.noarch 2022-03-15T05:48:52.231 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.232 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.232 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.232 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2018.10.15-7.el8.noarch 2022-03-15T05:48:52.232 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.11.5-5.el8.x86_64 2022-03-15T05:48:52.232 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.5.2-1.el8.noarch 2022-03-15T05:48:52.233 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2022-03-15T05:48:52.233 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2022-03-15T05:48:52.233 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2022-03-15T05:48:52.233 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-6.2-6.el8.noarch 2022-03-15T05:48:52.234 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2022-03-15T05:48:52.234 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.10.1-3.el8.noarch 2022-03-15T05:48:52.234 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-2.el8.noarch 2022-03-15T05:48:52.234 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-1.10-11.el8.noarch 2022-03-15T05:48:52.235 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-1.6.1-2.el8.noarch 2022-03-15T05:48:52.235 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2022-03-15T05:48:52.235 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-11.el8.noarch 2022-03-15T05:48:52.235 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.0.6-13.el8.noarch 2022-03-15T05:48:52.235 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-0.23-19.el8.x86_64 2022-03-15T05:48:52.236 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2022-03-15T05:48:52.236 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-2.el8.noarch 2022-03-15T05:48:52.236 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2022-03-15T05:48:52.236 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2022-03-15T05:48:52.237 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2022-03-15T05:48:52.237 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.3.2-9.el8.noarch 2022-03-15T05:48:52.237 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-2.6-1.el8.noarch 2022-03-15T05:48:52.237 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-14.el8.noarch 2022-03-15T05:48:52.237 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2022-03-15T05:48:52.238 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2022-03-15T05:48:52.238 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2022-03-15T05:48:52.238 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.14-14.el8.noarch 2022-03-15T05:48:52.238 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2017.2-9.el8.noarch 2022-03-15T05:48:52.239 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.239 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.239 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-6.el8.noarch 2022-03-15T05:48:52.239 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2022-03-15T05:48:52.240 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.240 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.4.1-12.el8.noarch 2022-03-15T05:48:52.240 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.8-1.el8.noarch 2022-03-15T05:48:52.240 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2022-03-15T05:48:52.241 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2022-03-15T05:48:52.241 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2022-03-15T05:48:52.241 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-1.14.1-5.el8.noarch 2022-03-15T05:48:52.241 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme-0.6.0-4.el8.noarch 2022-03-15T05:48:52.241 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2022-03-15T05:48:52.242 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.5-1.el8.1.noarch 2022-03-15T05:48:52.242 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2022-03-15T05:48:52.242 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest-2.0.33-1.el8.noarch 2022-03-15T05:48:52.242 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2022-03-15T05:48:52.243 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2022-03-15T05:48:52.243 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.243 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.244 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:17.0.0-11109.g1f661216.el8.x86_64 2022-03-15T05:48:52.244 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-1.el8.x86_64 2022-03-15T05:48:52.245 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2022-03-15T05:48:52.245 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2022-03-15T05:48:52.245 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-17.el8.x86_64 2022-03-15T05:48:52.246 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:52.246 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2022-03-15T05:48:52.553 DEBUG:teuthology.parallel:result is None 2022-03-15T05:48:52.554 DEBUG:teuthology.orchestra.run.smithi151:> sudo lsb_release -is 2022-03-15T05:48:52.687 INFO:teuthology.orchestra.run.smithi151.stdout:CentOSStream 2022-03-15T05:48:52.691 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-03-15T05:48:52.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1f661216557ac5e13e140eb1700d0e5a15dd3b4c 2022-03-15T05:48:52.849 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-03-15T05:48:52.913 INFO:teuthology.orchestra.run.smithi151.stdout:17.0.0-11109.g1f661216.el8 2022-03-15T05:48:52.915 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-11109.g1f661216.el8 2022-03-15T05:48:52.915 INFO:teuthology.task.install:The correct ceph version 17.0.0-11109.g1f661216 is installed. 2022-03-15T05:48:52.916 DEBUG:teuthology.orchestra.run.smithi164:> sudo lsb_release -is 2022-03-15T05:48:52.972 INFO:teuthology.orchestra.run.smithi164.stdout:CentOSStream 2022-03-15T05:48:52.973 DEBUG:teuthology.misc:System to be installed: CentOSStream 2022-03-15T05:48:52.974 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1f661216557ac5e13e140eb1700d0e5a15dd3b4c 2022-03-15T05:48:53.130 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2022-03-15T05:48:53.154 INFO:teuthology.orchestra.run.smithi164.stdout:17.0.0-11109.g1f661216.el8 2022-03-15T05:48:53.155 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-11109.g1f661216.el8 2022-03-15T05:48:53.155 INFO:teuthology.task.install:The correct ceph version 17.0.0-11109.g1f661216 is installed. 2022-03-15T05:48:53.156 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2022-03-15T05:48:53.156 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:48:53.157 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-03-15T05:48:53.239 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:48:53.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2022-03-15T05:48:53.270 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2022-03-15T05:48:53.271 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:48:53.271 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2022-03-15T05:48:53.359 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-03-15T05:48:53.442 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:48:53.442 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2022-03-15T05:48:53.472 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2022-03-15T05:48:53.541 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2022-03-15T05:48:53.542 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:48:53.542 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2022-03-15T05:48:53.626 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-03-15T05:48:53.715 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:48:53.715 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2022-03-15T05:48:53.746 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2022-03-15T05:48:53.816 INFO:teuthology.run_tasks:Running task ceph... 2022-03-15T05:48:53.875 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2022-03-15T05:48:53.876 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2022-03-15T05:48:53.881 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /var/log/ceph 2022-03-15T05:48:53.957 INFO:tasks.ceph:Disabling ceph logrotate... 2022-03-15T05:48:53.957 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2022-03-15T05:48:53.962 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/logrotate.d/ceph 2022-03-15T05:48:54.039 INFO:tasks.ceph:Creating extra log directories... 2022-03-15T05:48:54.040 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-03-15T05:48:54.044 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2022-03-15T05:48:54.131 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2022-03-15T05:48:54.132 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2022-03-15T05:48:54.132 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2022-03-15T05:48:54.132 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:48:54.133 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-03-15T05:48:54.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-03-15T05:48:54.362 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-03-15T05:48:54.446 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:48:54.447 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2022-03-15T05:48:54.466 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2022-03-15T05:48:54.582 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2022-03-15T05:48:54.617 INFO:tasks.ceph:Creating ceph cluster ceph... 2022-03-15T05:48:54.617 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2022-03-15T05:48:54.618 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi/6736039', 'branch': 'wip-vshankar-testing1-20220314-103400', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate} clusters/1a5s-mds-1c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} msgr-failures/none objectstore-ec/bluestore-bitmap overrides/{frag prefetch_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health whitelist_health whitelist_wrongly_marked_down} ranks/3 tasks/{1-thrash/mon 2-workunit/suites/iozone}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '6736039', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a020a702a220ecdaf67ca7cc4ca34d2178898edb'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2022-03-14_08:09:40-fs-wip-vshankar-testing1-20220314-103400-testing-default-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-20220314-103400'}, 'ceph': {'cephfs': {'max_mds': 3, 'mds_dir_prefetch': True, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'overall HEALTH_', '\\(MON_DOWN\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '1f661216557ac5e13e140eb1700d0e5a15dd3b4c'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1f661216557ac5e13e140eb1700d0e5a15dd3b4c'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-20220314-103400', 'sha1': '1f661216557ac5e13e140eb1700d0e5a15dd3b4c'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 200, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'sha1': '1f661216557ac5e13e140eb1700d0e5a15dd3b4c', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-20220314-103400', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_1f661216557ac5e13e140eb1700d0e5a15dd3b4c/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '1f661216557ac5e13e140eb1700d0e5a15dd3b4c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi151.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDSTY7zKSx+ovNZZxQ0HmLiwN8NDO8yxw6FfEib+xY6doNJkGrsW+eFvCGVeZOIT74bWASTOiTfenCNv7m63QweHDtmqdAc349QD0YTu1k+hAsfriTyuKuWCEYkA/cbfYG9r80pYB8s5/ccKcv4LXx44hoaazHmjuaGq0vu6KpyrFLrsW/oZUwxwmBzlKHPG6KtZIo98tf35a4BcygYn6bZXlrO8sQlscijoe3+tvLIPt+Tzbk5odgkYGOXnBvFFI5GW8IqPIQ60zRhb72j9w5Y24atD87blPaGXfDd/GXyN/sMkp2K5xhKHNaGFEu9YDrZcapliv45scdoaejvdu0oMGjXcTVxO4kEonUug/J0tOPQDtq8qr3/tNdrHlT7TEeL8g0fpwngfqJxDn0OCrXD3Byqmg6rTAeqLNWxYyJdFGOxweSnYqVG84grjDAt1t0OvJ9StCD/WoLRZZLN1DsePZZ/dkC60ygLgAmIRt9nLwVgyrffa//o8MJV8sjBFl0=', 'smithi164.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcI7+18kvVgGGVKopb2ohuxGfc7YgtMrHpDKEbqWe93O+WLlNU62KlWcZ5Ys9qGC0e+sxUJ33MkG33+rOpD7SdHDWyBJgAltt+5AIKJPVrA0RgZY6kkaO3WKzZ0N+D8xZtpQ24S5qSun068mdarxRwR1ko5vLHm+V+o0HL3fLHC6/XAzeXIklxNiiGQtXHiWsp/lZFiHX0oZdzDiA9sZvbUVKtU52bSKh86PUStVjQPXfixcQLgH4+g8mYDgo7TirYWMR8VbJFm8faCX7gHcZDoXHzitsIcDsTMDEARwll80cbBhS94y6VfSmRsOj4tyYBkLldqJH5l1GB3wTbTLlwLmkbXpm0209mwysfqcpOF9RoD3atW6/DASnRUF9d4729VFKjU93lvexdDsTQtcMt+9h8/gEPJpMCly6q160Xwa7LPLbkcMkhw1kCcizWliJJW1WtI+gI/Eoi77wisc2u36G1AT6csLtnJxx8nr8p7OvjgR4rXd5MApHf0rApZKk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'a020a702a220ecdaf67ca7cc4ca34d2178898edb'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '1f661216557ac5e13e140eb1700d0e5a15dd3b4c'}}, {'ceph': None}, {'kclient': None}, {'mon_thrash': {'check_mds_failover': True, 'revive_delay': 20, 'thrash_delay': 10}}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'fbfc7b381c1d662565abb9d3552d468766bf123c', 'timestamp': '2022-03-14_08:09:40', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.22301'} 2022-03-15T05:48:54.619 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-03-15T05:48:54.623 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2022-03-15T05:48:54.675 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2022-03-15T05:48:54.679 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m0777 -- /var/run/ceph 2022-03-15T05:48:54.764 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:48:54.764 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2022-03-15T05:48:54.819 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-03-15T05:48:54.819 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-03-15T05:48:54.876 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-03-15T05:48:54.877 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-15T05:48:54.877 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 448 Links: 1 2022-03-15T05:48:54.877 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-15T05:48:54.878 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2022-03-15T05:48:54.878 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2022-03-15 05:48:49.657440971 +0000 2022-03-15T05:48:54.878 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2022-03-15 05:46:06.282868378 +0000 2022-03-15T05:48:54.878 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2022-03-15 05:46:06.282868378 +0000 2022-03-15T05:48:54.879 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2022-03-15T05:48:54.904 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2022-03-15T05:48:54.905 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2022-03-15T05:48:54.905 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000716828 s, 714 kB/s 2022-03-15T05:48:54.915 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-03-15T05:48:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-03-15T05:48:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-15T05:48:54.970 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 454 Links: 1 2022-03-15T05:48:54.970 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-15T05:48:54.971 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2022-03-15T05:48:54.971 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2022-03-15 05:48:49.657440971 +0000 2022-03-15T05:48:54.971 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2022-03-15 05:46:06.831861628 +0000 2022-03-15T05:48:54.971 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2022-03-15 05:46:06.831861628 +0000 2022-03-15T05:48:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2022-03-15T05:48:54.998 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2022-03-15T05:48:54.999 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2022-03-15T05:48:54.999 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000832312 s, 615 kB/s 2022-03-15T05:48:55.008 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-03-15T05:48:55.064 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-03-15T05:48:55.065 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-15T05:48:55.065 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 460 Links: 1 2022-03-15T05:48:55.065 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-15T05:48:55.066 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2022-03-15T05:48:55.066 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2022-03-15 05:48:49.657440971 +0000 2022-03-15T05:48:55.066 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2022-03-15 05:46:07.354855198 +0000 2022-03-15T05:48:55.066 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2022-03-15 05:46:07.354855198 +0000 2022-03-15T05:48:55.066 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2022-03-15T05:48:55.092 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2022-03-15T05:48:55.092 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2022-03-15T05:48:55.093 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000616282 s, 831 kB/s 2022-03-15T05:48:55.101 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-03-15T05:48:55.157 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-03-15T05:48:55.158 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-15T05:48:55.158 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 466 Links: 1 2022-03-15T05:48:55.158 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-15T05:48:55.159 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2022-03-15T05:48:55.159 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2022-03-15 05:48:49.657440971 +0000 2022-03-15T05:48:55.159 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2022-03-15 05:46:07.881848718 +0000 2022-03-15T05:48:55.159 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2022-03-15 05:46:07.881848718 +0000 2022-03-15T05:48:55.160 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: - 2022-03-15T05:48:55.185 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2022-03-15T05:48:55.185 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2022-03-15T05:48:55.185 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000669536 s, 765 kB/s 2022-03-15T05:48:55.195 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-03-15T05:48:55.196 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:48:55.196 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2022-03-15T05:48:55.215 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-03-15T05:48:55.215 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-03-15T05:48:55.273 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-03-15T05:48:55.274 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-15T05:48:55.274 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 156448 Links: 1 2022-03-15T05:48:55.274 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-15T05:48:55.275 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2022-03-15T05:48:55.275 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2022-03-15 05:48:31.298908189 +0000 2022-03-15T05:48:55.275 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2022-03-15 05:45:00.419852543 +0000 2022-03-15T05:48:55.275 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2022-03-15 05:45:00.419852543 +0000 2022-03-15T05:48:55.276 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2022-03-15T05:48:55.284 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2022-03-15T05:48:55.285 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2022-03-15T05:48:55.285 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000299698 s, 1.7 MB/s 2022-03-15T05:48:55.288 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-03-15T05:48:55.346 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-03-15T05:48:55.347 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-15T05:48:55.347 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 159079 Links: 1 2022-03-15T05:48:55.347 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-15T05:48:55.347 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2022-03-15T05:48:55.347 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2022-03-15 05:48:31.298908189 +0000 2022-03-15T05:48:55.348 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2022-03-15 05:45:00.754846529 +0000 2022-03-15T05:48:55.348 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2022-03-15 05:45:00.754846529 +0000 2022-03-15T05:48:55.348 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2022-03-15T05:48:55.356 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2022-03-15T05:48:55.357 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2022-03-15T05:48:55.357 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000225378 s, 2.3 MB/s 2022-03-15T05:48:55.360 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-03-15T05:48:55.418 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-03-15T05:48:55.418 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-15T05:48:55.419 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 159139 Links: 1 2022-03-15T05:48:55.420 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-15T05:48:55.420 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2022-03-15T05:48:55.420 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2022-03-15 05:48:31.298908189 +0000 2022-03-15T05:48:55.420 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2022-03-15 05:45:01.089840516 +0000 2022-03-15T05:48:55.421 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2022-03-15 05:45:01.089840516 +0000 2022-03-15T05:48:55.421 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2022-03-15T05:48:55.427 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2022-03-15T05:48:55.427 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2022-03-15T05:48:55.428 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000216709 s, 2.4 MB/s 2022-03-15T05:48:55.430 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-03-15T05:48:55.487 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-03-15T05:48:55.487 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-15T05:48:55.487 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 6h/6d Inode: 160113 Links: 1 2022-03-15T05:48:55.488 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-15T05:48:55.488 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2022-03-15T05:48:55.488 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2022-03-15 05:48:31.298908189 +0000 2022-03-15T05:48:55.488 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2022-03-15 05:45:01.423834521 +0000 2022-03-15T05:48:55.489 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2022-03-15 05:45:01.423834521 +0000 2022-03-15T05:48:55.489 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2022-03-15T05:48:55.497 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2022-03-15T05:48:55.497 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2022-03-15T05:48:55.497 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000185969 s, 2.8 MB/s 2022-03-15T05:48:55.500 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-03-15T05:48:55.500 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-03-15T05:48:55.500 INFO:tasks.ceph:Generating config... 2022-03-15T05:48:55.502 INFO:tasks.ceph:[client] client mount timeout = 600 2022-03-15T05:48:55.503 INFO:tasks.ceph:[client] debug client = 20 2022-03-15T05:48:55.503 INFO:tasks.ceph:[client] debug ms = 1 2022-03-15T05:48:55.503 INFO:tasks.ceph:[client] rados mon op timeout = 900 2022-03-15T05:48:55.504 INFO:tasks.ceph:[client] rados osd op timeout = 900 2022-03-15T05:48:55.505 INFO:tasks.ceph:[global] ms die on skipped message = False 2022-03-15T05:48:55.505 INFO:tasks.ceph:[mds] debug mds = 20 2022-03-15T05:48:55.505 INFO:tasks.ceph:[mds] debug ms = 1 2022-03-15T05:48:55.506 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2022-03-15T05:48:55.506 INFO:tasks.ceph:[mds] mds bal merge size = 5 2022-03-15T05:48:55.506 INFO:tasks.ceph:[mds] mds bal split bits = 3 2022-03-15T05:48:55.507 INFO:tasks.ceph:[mds] mds bal split size = 100 2022-03-15T05:48:55.507 INFO:tasks.ceph:[mds] mds debug frag = True 2022-03-15T05:48:55.507 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2022-03-15T05:48:55.507 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = False 2022-03-15T05:48:55.508 INFO:tasks.ceph:[mds] mds op complaint time = 180 2022-03-15T05:48:55.508 INFO:tasks.ceph:[mds] mds verify scatter = True 2022-03-15T05:48:55.508 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2022-03-15T05:48:55.509 INFO:tasks.ceph:[mds] osd op complaint time = 180 2022-03-15T05:48:55.509 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2022-03-15T05:48:55.509 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2022-03-15T05:48:55.510 INFO:tasks.ceph:[mgr] debug mgr = 20 2022-03-15T05:48:55.510 INFO:tasks.ceph:[mgr] debug ms = 1 2022-03-15T05:48:55.510 INFO:tasks.ceph:[mon] debug mon = 20 2022-03-15T05:48:55.510 INFO:tasks.ceph:[mon] debug ms = 1 2022-03-15T05:48:55.511 INFO:tasks.ceph:[mon] debug paxos = 20 2022-03-15T05:48:55.511 INFO:tasks.ceph:[mon] mon op complaint time = 120 2022-03-15T05:48:55.511 INFO:tasks.ceph:[osd] bdev async discard = True 2022-03-15T05:48:55.512 INFO:tasks.ceph:[osd] bdev enable discard = True 2022-03-15T05:48:55.512 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2022-03-15T05:48:55.512 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2022-03-15T05:48:55.513 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2022-03-15T05:48:55.513 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2022-03-15T05:48:55.513 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2022-03-15T05:48:55.513 INFO:tasks.ceph:[osd] debug ms = 1 2022-03-15T05:48:55.514 INFO:tasks.ceph:[osd] debug osd = 20 2022-03-15T05:48:55.514 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2022-03-15T05:48:55.514 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2022-03-15T05:48:55.515 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2022-03-15T05:48:55.515 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2022-03-15T05:48:55.515 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2022-03-15T05:48:55.516 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2022-03-15T05:48:55.516 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2022-03-15T05:48:55.516 INFO:tasks.ceph:[osd] osd op complaint time = 180 2022-03-15T05:48:55.517 INFO:tasks.ceph:Setting up mon.a... 2022-03-15T05:48:55.517 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2022-03-15T05:48:55.668 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.keyring 2022-03-15T05:48:55.676 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2022-03-15T05:48:55.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-03-15T05:48:55.876 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.151'), ('mon.b', '172.21.15.164'), ('mon.c', '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]')] 2022-03-15T05:48:55.877 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.151,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': False, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_sleep_rank_change': 5000000.0, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2022-03-15T05:48:55.878 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:48:55.879 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2022-03-15T05:48:55.932 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.151 --add b 172.21.15.164 --addv c '[v2:172.21.15.164:3301,v1:172.21.15.164:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:48:56.029 INFO:teuthology.orchestra.run.smithi151.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:48:56.029 INFO:teuthology.orchestra.run.smithi151.stdout:monmaptool: generated fsid 9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c 2022-03-15T05:48:56.030 INFO:teuthology.orchestra.run.smithi151.stdout:setting min_mon_release = octopus 2022-03-15T05:48:56.030 INFO:teuthology.orchestra.run.smithi151.stdout:epoch 0 2022-03-15T05:48:56.030 INFO:teuthology.orchestra.run.smithi151.stdout:fsid 9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c 2022-03-15T05:48:56.030 INFO:teuthology.orchestra.run.smithi151.stdout:last_changed 2022-03-15T05:48:56.028066+0000 2022-03-15T05:48:56.031 INFO:teuthology.orchestra.run.smithi151.stdout:created 2022-03-15T05:48:56.028066+0000 2022-03-15T05:48:56.031 INFO:teuthology.orchestra.run.smithi151.stdout:min_mon_release 15 (octopus) 2022-03-15T05:48:56.031 INFO:teuthology.orchestra.run.smithi151.stdout:election_strategy: 1 2022-03-15T05:48:56.031 INFO:teuthology.orchestra.run.smithi151.stdout:0: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.a 2022-03-15T05:48:56.032 INFO:teuthology.orchestra.run.smithi151.stdout:1: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.b 2022-03-15T05:48:56.032 INFO:teuthology.orchestra.run.smithi151.stdout:2: [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] mon.c 2022-03-15T05:48:56.032 INFO:teuthology.orchestra.run.smithi151.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2022-03-15T05:48:56.034 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2022-03-15T05:48:56.088 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c... 2022-03-15T05:48:56.089 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-03-15T05:48:56.095 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2022-03-15T05:48:56.148 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2022-03-15T05:48:56.148 INFO:teuthology.orchestra.run.smithi164.stdout: chdir = "" 2022-03-15T05:48:56.148 INFO:teuthology.orchestra.run.smithi164.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-03-15T05:48:56.148 INFO:teuthology.orchestra.run.smithi164.stdout: auth supported = cephx 2022-03-15T05:48:56.149 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.149 INFO:teuthology.orchestra.run.smithi164.stdout: filestore xattr use omap = true 2022-03-15T05:48:56.149 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.149 INFO:teuthology.orchestra.run.smithi164.stdout: mon clock drift allowed = 1.000 2022-03-15T05:48:56.150 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.150 INFO:teuthology.orchestra.run.smithi164.stdout: osd crush chooseleaf type = 0 2022-03-15T05:48:56.150 INFO:teuthology.orchestra.run.smithi164.stdout: auth debug = true 2022-03-15T05:48:56.150 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.150 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on old message = true 2022-03-15T05:48:56.151 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on bug = true 2022-03-15T05:48:56.151 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.151 INFO:teuthology.orchestra.run.smithi164.stdout: mon max pg per osd = 10000 # >= luminous 2022-03-15T05:48:56.151 INFO:teuthology.orchestra.run.smithi164.stdout: mon pg warn max object skew = 0 2022-03-15T05:48:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: # disable pg_autoscaler by default for new pools 2022-03-15T05:48:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: osd_pool_default_pg_autoscale_mode = off 2022-03-15T05:48:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.152 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default size = 2 2022-03-15T05:48:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow primary affinity = true 2022-03-15T05:48:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd allow pg remap = true 2022-03-15T05:48:56.153 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on legacy crush tunables = false 2022-03-15T05:48:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on crush straw calc version zero = false 2022-03-15T05:48:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on no sortbitwise = false 2022-03-15T05:48:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on osd down out interval zero = false 2022-03-15T05:48:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: mon warn on too few osds = false 2022-03-15T05:48:56.154 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-03-15T05:48:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_pool_no_redundancy = false 2022-03-15T05:48:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: mon_allow_pool_size_one = true 2022-03-15T05:48:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.155 INFO:teuthology.orchestra.run.smithi164.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-03-15T05:48:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: osd default data pool replay window = 5 2022-03-15T05:48:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: mon allow pool delete = true 2022-03-15T05:48:56.156 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: mon cluster log file level = debug 2022-03-15T05:48:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: debug asserts on shutdown = true 2022-03-15T05:48:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: mon health detail to clog = false 2022-03-15T05:48:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: mon host = "172.21.15.151,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2022-03-15T05:48:56.157 INFO:teuthology.orchestra.run.smithi164.stdout: ms die on skipped message = False 2022-03-15T05:48:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = 9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c 2022-03-15T05:48:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.158 INFO:teuthology.orchestra.run.smithi164.stdout:[osd] 2022-03-15T05:48:56.158 INFO:teuthology.orchestra.run.smithi164.stdout: osd journal size = 100 2022-03-15T05:48:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub load threshold = 5.0 2022-03-15T05:48:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: osd scrub max interval = 600 2022-03-15T05:48:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.159 INFO:teuthology.orchestra.run.smithi164.stdout: osd recover clone overlap = true 2022-03-15T05:48:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: osd recovery max chunk = 1048576 2022-03-15T05:48:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug shutdown = true 2022-03-15T05:48:56.160 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug op order = true 2022-03-15T05:48:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug verify stray on activate = true 2022-03-15T05:48:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: osd open classes on start = true 2022-03-15T05:48:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug pg log writeout = true 2022-03-15T05:48:56.161 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: osd deep scrub update digest min age = 30 2022-03-15T05:48:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: osd map max advance = 10 2022-03-15T05:48:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.162 INFO:teuthology.orchestra.run.smithi164.stdout: journal zero on create = true 2022-03-15T05:48:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: filestore ondisk finisher threads = 3 2022-03-15T05:48:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: filestore apply finisher threads = 3 2022-03-15T05:48:56.163 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: bdev debug aio = true 2022-03-15T05:48:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: osd debug misdirected ops = true 2022-03-15T05:48:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: bdev async discard = True 2022-03-15T05:48:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: bdev enable discard = True 2022-03-15T05:48:56.164 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore allocator = bitmap 2022-03-15T05:48:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore block size = 96636764160 2022-03-15T05:48:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: bluestore fsck on mount = True 2022-03-15T05:48:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluefs = 1/20 2022-03-15T05:48:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: debug bluestore = 1/20 2022-03-15T05:48:56.165 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2022-03-15T05:48:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: debug osd = 20 2022-03-15T05:48:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: debug rocksdb = 4/10 2022-03-15T05:48:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd backfillfull_ratio = 0.85 2022-03-15T05:48:56.166 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd full ratio = 0.9 2022-03-15T05:48:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd nearfull ratio = 0.8 2022-03-15T05:48:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd failsafe full ratio = 0.95 2022-03-15T05:48:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd max markdown count = 1000 2022-03-15T05:48:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd objectstore = bluestore 2022-03-15T05:48:56.167 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2022-03-15T05:48:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.168 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr] 2022-03-15T05:48:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2022-03-15T05:48:56.168 INFO:teuthology.orchestra.run.smithi164.stdout: debug mgr = 20 2022-03-15T05:48:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2022-03-15T05:48:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2022-03-15T05:48:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2022-03-15T05:48:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2022-03-15T05:48:56.169 INFO:teuthology.orchestra.run.smithi164.stdout: mgr/telemetry/nag = false 2022-03-15T05:48:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.170 INFO:teuthology.orchestra.run.smithi164.stdout:[mon] 2022-03-15T05:48:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2022-03-15T05:48:56.170 INFO:teuthology.orchestra.run.smithi164.stdout: debug mon = 20 2022-03-15T05:48:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: debug paxos = 20 2022-03-15T05:48:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: debug auth = 20 2022-03-15T05:48:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: mon data avail warn = 5 2022-03-15T05:48:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: mon mgr mkfs grace = 240 2022-03-15T05:48:56.171 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min pgs per osd = 4 2022-03-15T05:48:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd reporter subtree level = osd 2022-03-15T05:48:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: mon osd prime pg temp = true 2022-03-15T05:48:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: mon reweight min bytes per osd = 10 2022-03-15T05:48:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.172 INFO:teuthology.orchestra.run.smithi164.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-03-15T05:48:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: auth mon ticket ttl = 660 # 11m 2022-03-15T05:48:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: auth service ticket ttl = 240 # 4m 2022-03-15T05:48:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.173 INFO:teuthology.orchestra.run.smithi164.stdout: # don't complain about insecure global_id in the test suite 2022-03-15T05:48:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-03-15T05:48:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-03-15T05:48:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: # 1m isn't quite enough 2022-03-15T05:48:56.174 INFO:teuthology.orchestra.run.smithi164.stdout: mon_down_mkfs_grace = 2m 2022-03-15T05:48:56.175 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.180 INFO:teuthology.orchestra.run.smithi164.stdout: mon_warn_on_filestore_osds = false 2022-03-15T05:48:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: mon op complaint time = 120 2022-03-15T05:48:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: 2022-03-15T05:48:56.181 INFO:teuthology.orchestra.run.smithi164.stdout:[client] 2022-03-15T05:48:56.181 INFO:teuthology.orchestra.run.smithi164.stdout: rgw cache enabled = true 2022-03-15T05:48:56.182 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable ops log = true 2022-03-15T05:48:56.182 INFO:teuthology.orchestra.run.smithi164.stdout: rgw enable usage log = true 2022-03-15T05:48:56.182 INFO:teuthology.orchestra.run.smithi164.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-03-15T05:48:56.182 INFO:teuthology.orchestra.run.smithi164.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-03-15T05:48:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: client mount timeout = 600 2022-03-15T05:48:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: debug client = 20 2022-03-15T05:48:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2022-03-15T05:48:56.183 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2022-03-15T05:48:56.184 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2022-03-15T05:48:56.184 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.a] 2022-03-15T05:48:56.184 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.b] 2022-03-15T05:48:56.184 INFO:teuthology.orchestra.run.smithi164.stdout:[mon.c] 2022-03-15T05:48:56.184 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2022-03-15T05:48:56.185 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2022-03-15T05:48:56.185 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.e] 2022-03-15T05:48:56.185 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2022-03-15T05:48:56.185 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2022-03-15T05:48:56.186 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.f] 2022-03-15T05:48:56.186 INFO:teuthology.orchestra.run.smithi164.stdout:[mds] 2022-03-15T05:48:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: debug mds = 20 2022-03-15T05:48:56.186 INFO:teuthology.orchestra.run.smithi164.stdout: debug ms = 1 2022-03-15T05:48:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal fragment size max = 10000 2022-03-15T05:48:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal merge size = 5 2022-03-15T05:48:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal split bits = 3 2022-03-15T05:48:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: mds bal split size = 100 2022-03-15T05:48:56.187 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug frag = True 2022-03-15T05:48:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: mds debug scatterstat = True 2022-03-15T05:48:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: mds oft prefetch dirfrags = False 2022-03-15T05:48:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: mds op complaint time = 180 2022-03-15T05:48:56.188 INFO:teuthology.orchestra.run.smithi164.stdout: mds verify scatter = True 2022-03-15T05:48:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: mds_sleep_rank_change = 5000000.0 2022-03-15T05:48:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: osd op complaint time = 180 2022-03-15T05:48:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: rados mon op timeout = 900 2022-03-15T05:48:56.189 INFO:teuthology.orchestra.run.smithi164.stdout: rados osd op timeout = 900 2022-03-15T05:48:56.226 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2022-03-15T05:48:56.227 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2022-03-15T05:48:56.227 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2022-03-15T05:48:56.227 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2022-03-15T05:48:56.227 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.228 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2022-03-15T05:48:56.228 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.228 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2022-03-15T05:48:56.228 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.229 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2022-03-15T05:48:56.229 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2022-03-15T05:48:56.229 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.229 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2022-03-15T05:48:56.229 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2022-03-15T05:48:56.230 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.230 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2022-03-15T05:48:56.230 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2022-03-15T05:48:56.230 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.231 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2022-03-15T05:48:56.231 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2022-03-15T05:48:56.231 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.231 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2022-03-15T05:48:56.232 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.232 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2022-03-15T05:48:56.232 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2022-03-15T05:48:56.232 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2022-03-15T05:48:56.232 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2022-03-15T05:48:56.233 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2022-03-15T05:48:56.233 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2022-03-15T05:48:56.233 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2022-03-15T05:48:56.233 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2022-03-15T05:48:56.233 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2022-03-15T05:48:56.234 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2022-03-15T05:48:56.234 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.234 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2022-03-15T05:48:56.234 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.235 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2022-03-15T05:48:56.235 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.235 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2022-03-15T05:48:56.235 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.235 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2022-03-15T05:48:56.236 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2022-03-15T05:48:56.236 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2022-03-15T05:48:56.236 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.151,172.21.15.164,[v2:172.21.15.164:3301,v1:172.21.15.164:6790]" 2022-03-15T05:48:56.236 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on skipped message = False 2022-03-15T05:48:56.237 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c 2022-03-15T05:48:56.237 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.237 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2022-03-15T05:48:56.237 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2022-03-15T05:48:56.237 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.238 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2022-03-15T05:48:56.238 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2022-03-15T05:48:56.238 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.238 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2022-03-15T05:48:56.239 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2022-03-15T05:48:56.239 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.239 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2022-03-15T05:48:56.239 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2022-03-15T05:48:56.239 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2022-03-15T05:48:56.240 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.240 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2022-03-15T05:48:56.240 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2022-03-15T05:48:56.240 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.241 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2022-03-15T05:48:56.241 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.241 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2022-03-15T05:48:56.241 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.241 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2022-03-15T05:48:56.242 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.242 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2022-03-15T05:48:56.242 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2022-03-15T05:48:56.242 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.243 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2022-03-15T05:48:56.243 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2022-03-15T05:48:56.243 INFO:teuthology.orchestra.run.smithi151.stdout: bdev async discard = True 2022-03-15T05:48:56.243 INFO:teuthology.orchestra.run.smithi151.stdout: bdev enable discard = True 2022-03-15T05:48:56.244 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore allocator = bitmap 2022-03-15T05:48:56.244 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2022-03-15T05:48:56.244 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2022-03-15T05:48:56.244 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 1/20 2022-03-15T05:48:56.244 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 1/20 2022-03-15T05:48:56.245 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2022-03-15T05:48:56.245 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2022-03-15T05:48:56.245 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 4/10 2022-03-15T05:48:56.245 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2022-03-15T05:48:56.246 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2022-03-15T05:48:56.246 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2022-03-15T05:48:56.246 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2022-03-15T05:48:56.246 INFO:teuthology.orchestra.run.smithi151.stdout: osd max markdown count = 1000 2022-03-15T05:48:56.247 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2022-03-15T05:48:56.247 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2022-03-15T05:48:56.247 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.247 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2022-03-15T05:48:56.247 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2022-03-15T05:48:56.248 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2022-03-15T05:48:56.248 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2022-03-15T05:48:56.248 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2022-03-15T05:48:56.248 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2022-03-15T05:48:56.249 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2022-03-15T05:48:56.249 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2022-03-15T05:48:56.249 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.249 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2022-03-15T05:48:56.249 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2022-03-15T05:48:56.250 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2022-03-15T05:48:56.250 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2022-03-15T05:48:56.250 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2022-03-15T05:48:56.250 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2022-03-15T05:48:56.251 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2022-03-15T05:48:56.251 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2022-03-15T05:48:56.251 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2022-03-15T05:48:56.251 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2022-03-15T05:48:56.252 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2022-03-15T05:48:56.252 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.252 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2022-03-15T05:48:56.252 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2022-03-15T05:48:56.253 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2022-03-15T05:48:56.253 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.253 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2022-03-15T05:48:56.253 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2022-03-15T05:48:56.253 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2022-03-15T05:48:56.254 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.254 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2022-03-15T05:48:56.254 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2022-03-15T05:48:56.254 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.255 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2022-03-15T05:48:56.255 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2022-03-15T05:48:56.255 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:48:56.255 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2022-03-15T05:48:56.256 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2022-03-15T05:48:56.256 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2022-03-15T05:48:56.256 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2022-03-15T05:48:56.256 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2022-03-15T05:48:56.256 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2022-03-15T05:48:56.257 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2022-03-15T05:48:56.257 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2022-03-15T05:48:56.257 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2022-03-15T05:48:56.257 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2022-03-15T05:48:56.258 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2022-03-15T05:48:56.258 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2022-03-15T05:48:56.258 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2022-03-15T05:48:56.258 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2022-03-15T05:48:56.259 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2022-03-15T05:48:56.259 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2022-03-15T05:48:56.259 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.e] 2022-03-15T05:48:56.259 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2022-03-15T05:48:56.259 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2022-03-15T05:48:56.260 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.f] 2022-03-15T05:48:56.260 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2022-03-15T05:48:56.260 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2022-03-15T05:48:56.260 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2022-03-15T05:48:56.260 INFO:teuthology.orchestra.run.smithi151.stdout: mds bal fragment size max = 10000 2022-03-15T05:48:56.261 INFO:teuthology.orchestra.run.smithi151.stdout: mds bal merge size = 5 2022-03-15T05:48:56.261 INFO:teuthology.orchestra.run.smithi151.stdout: mds bal split bits = 3 2022-03-15T05:48:56.261 INFO:teuthology.orchestra.run.smithi151.stdout: mds bal split size = 100 2022-03-15T05:48:56.261 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2022-03-15T05:48:56.262 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2022-03-15T05:48:56.262 INFO:teuthology.orchestra.run.smithi151.stdout: mds oft prefetch dirfrags = False 2022-03-15T05:48:56.262 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2022-03-15T05:48:56.262 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2022-03-15T05:48:56.263 INFO:teuthology.orchestra.run.smithi151.stdout: mds_sleep_rank_change = 5000000.0 2022-03-15T05:48:56.263 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2022-03-15T05:48:56.263 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2022-03-15T05:48:56.263 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2022-03-15T05:48:56.264 INFO:tasks.ceph:Creating admin key on mon.a... 2022-03-15T05:48:56.265 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2022-03-15T05:48:56.392 INFO:tasks.ceph:Copying monmap to all nodes... 2022-03-15T05:48:56.392 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:48:56.393 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2022-03-15T05:48:56.446 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:48:56.446 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2022-03-15T05:48:56.500 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2022-03-15T05:48:56.501 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:48:56.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2022-03-15T05:48:56.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-03-15T05:48:56.615 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:48:56.616 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:48:56.671 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi164.front.sepia.ceph.com 2022-03-15T05:48:56.671 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:48:56.672 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.keyring 2022-03-15T05:48:56.672 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.keyring 2022-03-15T05:48:56.715 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:48:56.716 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:48:56.774 INFO:tasks.ceph:Setting up mon nodes... 2022-03-15T05:48:56.774 INFO:tasks.ceph:Setting up mgr nodes... 2022-03-15T05:48:56.775 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2022-03-15T05:48:56.918 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2022-03-15T05:48:56.927 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2022-03-15T05:48:56.992 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2022-03-15T05:48:56.995 INFO:tasks.ceph:Setting up mds nodes... 2022-03-15T05:48:56.995 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2022-03-15T05:48:57.137 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2022-03-15T05:48:57.146 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2022-03-15T05:48:57.230 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2022-03-15T05:48:57.370 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2022-03-15T05:48:57.378 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2022-03-15T05:48:57.463 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2022-03-15T05:48:57.602 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2022-03-15T05:48:57.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2022-03-15T05:48:57.695 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2022-03-15T05:48:57.754 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2022-03-15T05:48:57.756 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2022-03-15T05:48:57.785 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2022-03-15T05:48:57.877 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2022-03-15T05:48:57.879 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2022-03-15T05:48:57.905 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2022-03-15T05:48:57.995 INFO:teuthology.orchestra.run.smithi164.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2022-03-15T05:48:57.997 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2022-03-15T05:48:58.024 INFO:tasks.ceph_client:Setting up client nodes... 2022-03-15T05:48:58.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-03-15T05:48:58.134 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.0.keyring 2022-03-15T05:48:58.172 INFO:tasks.ceph:Running mkfs on osd nodes... 2022-03-15T05:48:58.172 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi164.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2022-03-15T05:48:58.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2022-03-15T05:48:58.257 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-03-15T05:48:58.257 INFO:tasks.ceph:role: osd.0 2022-03-15T05:48:58.258 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2022-03-15T05:48:58.258 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-03-15T05:48:58.346 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-03-15T05:48:58.346 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-15T05:48:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-15T05:48:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-03-15T05:48:58.347 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-15T05:48:58.347 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2022-03-15T05:48:58.348 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-15T05:48:58.348 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-15T05:48:58.348 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-15T05:48:58.348 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-15T05:48:58.776 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2022-03-15T05:48:58.783 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2022-03-15T05:48:58.784 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2022-03-15T05:48:58.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2022-03-15T05:48:59.066 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2022-03-15T05:48:59.150 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-03-15T05:48:59.150 INFO:tasks.ceph:role: osd.1 2022-03-15T05:48:59.151 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2022-03-15T05:48:59.151 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-03-15T05:48:59.240 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-03-15T05:48:59.241 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-15T05:48:59.241 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-15T05:48:59.241 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-03-15T05:48:59.241 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-15T05:48:59.242 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2022-03-15T05:48:59.242 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-15T05:48:59.242 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-15T05:48:59.242 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-15T05:48:59.242 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-15T05:48:59.642 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2022-03-15T05:48:59.649 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2022-03-15T05:48:59.650 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2022-03-15T05:48:59.805 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2022-03-15T05:48:59.900 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2022-03-15T05:48:59.985 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-03-15T05:48:59.985 INFO:tasks.ceph:role: osd.2 2022-03-15T05:48:59.985 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2022-03-15T05:48:59.986 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-03-15T05:49:00.075 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-03-15T05:49:00.075 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-15T05:49:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-15T05:49:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-03-15T05:49:00.076 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-15T05:49:00.076 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2022-03-15T05:49:00.077 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-15T05:49:00.077 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-15T05:49:00.077 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-15T05:49:00.077 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-15T05:49:00.529 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2022-03-15T05:49:00.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2022-03-15T05:49:00.536 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2022-03-15T05:49:00.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2022-03-15T05:49:00.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2022-03-15T05:49:00.904 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2022-03-15T05:49:00.905 INFO:tasks.ceph:role: osd.3 2022-03-15T05:49:00.905 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2022-03-15T05:49:00.905 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-03-15T05:49:00.995 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-03-15T05:49:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-15T05:49:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-15T05:49:00.996 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-03-15T05:49:00.996 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-15T05:49:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2022-03-15T05:49:00.997 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-15T05:49:00.997 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-15T05:49:00.997 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-15T05:49:00.997 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-15T05:49:01.422 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2022-03-15T05:49:01.428 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2022-03-15T05:49:01.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2022-03-15T05:49:01.541 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2022-03-15T05:49:01.630 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:49:01.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:01.770+0000 7f08d35393c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2022-03-15T05:49:01.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:01.770+0000 7f08d35393c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2022-03-15T05:49:01.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:01.770+0000 7f08d35393c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-03-15T05:49:01.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:01.770+0000 7f08d35393c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-03-15T05:49:01.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:01.770+0000 7f08d35393c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2022-03-15T05:49:01.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:01.773+0000 7f08d35393c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2022-03-15T05:49:05.229 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-03-15T05:49:05.311 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:49:05.430 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:05.428+0000 7f3b6106d3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2022-03-15T05:49:05.431 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:05.428+0000 7f3b6106d3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2022-03-15T05:49:05.431 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:05.428+0000 7f3b6106d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-03-15T05:49:05.431 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:05.428+0000 7f3b6106d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-03-15T05:49:05.431 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:05.428+0000 7f3b6106d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2022-03-15T05:49:05.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:05.430+0000 7f3b6106d3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2022-03-15T05:49:08.850 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2022-03-15T05:49:08.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:49:09.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:09.045+0000 7f6281d243c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2022-03-15T05:49:09.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:09.045+0000 7f6281d243c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2022-03-15T05:49:09.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:09.045+0000 7f6281d243c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-03-15T05:49:09.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:09.045+0000 7f6281d243c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-03-15T05:49:09.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:09.045+0000 7f6281d243c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2022-03-15T05:49:09.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:09.047+0000 7f6281d243c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2022-03-15T05:49:12.485 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2022-03-15T05:49:12.568 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:49:12.683 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:12.680+0000 7fbf2d67f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2022-03-15T05:49:12.683 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:12.681+0000 7fbf2d67f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2022-03-15T05:49:12.683 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:12.681+0000 7fbf2d67f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-03-15T05:49:12.684 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:12.681+0000 7fbf2d67f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-03-15T05:49:12.684 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:12.681+0000 7fbf2d67f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2022-03-15T05:49:12.684 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:12.683+0000 7fbf2d67f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2022-03-15T05:49:16.102 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2022-03-15T05:49:16.184 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2022-03-15T05:49:16.216 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-03-15T05:49:16.217 INFO:tasks.ceph:role: osd.4 2022-03-15T05:49:16.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com 2022-03-15T05:49:16.218 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2022-03-15T05:49:16.294 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2022-03-15T05:49:16.295 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-15T05:49:16.295 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-15T05:49:16.295 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-03-15T05:49:16.295 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-15T05:49:16.296 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2022-03-15T05:49:16.296 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-15T05:49:16.296 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-15T05:49:16.296 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-15T05:49:16.297 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-15T05:49:16.723 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2022-03-15T05:49:16.725 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2022-03-15T05:49:16.725 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2022-03-15T05:49:16.871 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2022-03-15T05:49:16.906 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2022-03-15T05:49:16.975 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-03-15T05:49:16.976 INFO:tasks.ceph:role: osd.5 2022-03-15T05:49:16.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com 2022-03-15T05:49:16.977 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2022-03-15T05:49:17.050 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2022-03-15T05:49:17.050 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-15T05:49:17.051 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-15T05:49:17.051 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-03-15T05:49:17.051 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-15T05:49:17.051 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2022-03-15T05:49:17.052 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-15T05:49:17.052 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-15T05:49:17.052 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-15T05:49:17.052 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-15T05:49:17.477 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2022-03-15T05:49:17.479 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2022-03-15T05:49:17.480 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2022-03-15T05:49:17.584 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2022-03-15T05:49:17.617 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2022-03-15T05:49:17.685 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-03-15T05:49:17.685 INFO:tasks.ceph:role: osd.6 2022-03-15T05:49:17.685 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com 2022-03-15T05:49:17.686 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2022-03-15T05:49:17.760 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2022-03-15T05:49:17.760 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-15T05:49:17.761 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-15T05:49:17.761 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-03-15T05:49:17.761 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-15T05:49:17.761 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2022-03-15T05:49:17.761 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-15T05:49:17.762 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-15T05:49:17.762 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-15T05:49:17.762 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-15T05:49:18.211 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2022-03-15T05:49:18.213 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2022-03-15T05:49:18.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2022-03-15T05:49:18.372 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2022-03-15T05:49:18.407 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2022-03-15T05:49:18.475 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2022-03-15T05:49:18.476 INFO:tasks.ceph:role: osd.7 2022-03-15T05:49:18.477 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com 2022-03-15T05:49:18.477 DEBUG:teuthology.orchestra.run.smithi164:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2022-03-15T05:49:18.549 INFO:teuthology.orchestra.run.smithi164.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2022-03-15T05:49:18.550 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 attr=2, projid32bit=1 2022-03-15T05:49:18.550 INFO:teuthology.orchestra.run.smithi164.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2022-03-15T05:49:18.550 INFO:teuthology.orchestra.run.smithi164.stdout: = reflink=1 bigtime=0 inobtcount=0 2022-03-15T05:49:18.550 INFO:teuthology.orchestra.run.smithi164.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2022-03-15T05:49:18.551 INFO:teuthology.orchestra.run.smithi164.stdout: = sunit=0 swidth=0 blks 2022-03-15T05:49:18.551 INFO:teuthology.orchestra.run.smithi164.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2022-03-15T05:49:18.551 INFO:teuthology.orchestra.run.smithi164.stdout:log =internal log bsize=4096 blocks=11443, version=2 2022-03-15T05:49:18.552 INFO:teuthology.orchestra.run.smithi164.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2022-03-15T05:49:18.552 INFO:teuthology.orchestra.run.smithi164.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2022-03-15T05:49:18.991 INFO:teuthology.orchestra.run.smithi164.stdout:Discarding blocks...Done. 2022-03-15T05:49:18.992 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi164.front.sepia.ceph.com -o noatime 2022-03-15T05:49:18.993 DEBUG:teuthology.orchestra.run.smithi164:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2022-03-15T05:49:19.159 DEBUG:teuthology.orchestra.run.smithi164:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2022-03-15T05:49:19.189 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:49:19.273 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:19.270+0000 7fd9d68e33c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2022-03-15T05:49:19.273 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:19.271+0000 7fd9d68e33c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2022-03-15T05:49:19.273 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:19.271+0000 7fd9d68e33c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-03-15T05:49:19.273 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:19.271+0000 7fd9d68e33c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-03-15T05:49:19.274 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:19.271+0000 7fd9d68e33c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2022-03-15T05:49:19.274 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:19.271+0000 7fd9d68e33c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2022-03-15T05:49:22.138 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2022-03-15T05:49:22.210 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:49:22.300 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:22.297+0000 7f48e39e03c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2022-03-15T05:49:22.301 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:22.298+0000 7f48e39e03c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2022-03-15T05:49:22.301 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:22.298+0000 7f48e39e03c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-03-15T05:49:22.301 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:22.298+0000 7f48e39e03c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-03-15T05:49:22.302 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:22.298+0000 7f48e39e03c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2022-03-15T05:49:22.302 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:22.298+0000 7f48e39e03c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2022-03-15T05:49:24.620 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:49:24.626 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:49:25.163 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2022-03-15T05:49:25.194 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:49:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:25.278+0000 7f753f7163c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2022-03-15T05:49:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:25.279+0000 7f753f7163c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2022-03-15T05:49:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:25.279+0000 7f753f7163c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-03-15T05:49:25.283 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:25.279+0000 7f753f7163c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-03-15T05:49:25.283 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:25.279+0000 7f753f7163c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2022-03-15T05:49:25.283 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:25.279+0000 7f753f7163c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2022-03-15T05:49:28.146 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2022-03-15T05:49:28.178 DEBUG:teuthology.orchestra.run.smithi164:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:49:28.265 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:28.262+0000 7fe5b18cf3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2022-03-15T05:49:28.266 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:28.262+0000 7fe5b18cf3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2022-03-15T05:49:28.266 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:28.262+0000 7fe5b18cf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-03-15T05:49:28.266 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:28.262+0000 7fe5b18cf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-03-15T05:49:28.267 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:28.262+0000 7fe5b18cf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2022-03-15T05:49:28.267 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:28.263+0000 7fe5b18cf3c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2022-03-15T05:49:31.125 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2022-03-15T05:49:31.156 INFO:tasks.ceph:Reading keys from all nodes... 2022-03-15T05:49:31.157 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:31.157 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2022-03-15T05:49:31.242 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:31.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2022-03-15T05:49:31.323 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:31.323 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2022-03-15T05:49:31.402 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:31.403 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2022-03-15T05:49:31.481 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:31.481 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2022-03-15T05:49:31.560 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:31.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2022-03-15T05:49:31.639 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:31.639 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2022-03-15T05:49:31.718 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:31.718 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2022-03-15T05:49:31.797 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:31.827 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2022-03-15T05:49:31.859 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:31.859 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2022-03-15T05:49:31.929 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:31.929 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2022-03-15T05:49:31.997 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:31.998 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2022-03-15T05:49:32.065 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:32.066 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2022-03-15T05:49:32.133 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:32.133 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2022-03-15T05:49:32.200 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:32.201 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2022-03-15T05:49:32.268 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:32.268 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2022-03-15T05:49:32.334 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:32.334 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2022-03-15T05:49:32.389 INFO:tasks.ceph:Adding keys to all mons... 2022-03-15T05:49:32.389 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2022-03-15T05:49:32.394 DEBUG:teuthology.orchestra.run.smithi164:> sudo tee -a /etc/ceph/ceph.keyring 2022-03-15T05:49:32.419 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.y] 2022-03-15T05:49:32.420 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDIKDBintaxNhAALXikcUhAfZE1IizuQjJ4Bw== 2022-03-15T05:49:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a] 2022-03-15T05:49:32.420 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDJKDBir5EfCBAAmY7/02rcKdNZA999quCtgA== 2022-03-15T05:49:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c] 2022-03-15T05:49:32.421 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDJKDBiRKj7FRAArf6WkwaWOc5ciJ2JY1NjWA== 2022-03-15T05:49:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.e] 2022-03-15T05:49:32.421 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDJKDBiqGvUIxAACrFMpZ4JLbsqOS7dnF5hAQ== 2022-03-15T05:49:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.0] 2022-03-15T05:49:32.421 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDNKDBiCArzLRAAibEPDLVxdBEarPyZC0rl5w== 2022-03-15T05:49:32.422 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.1] 2022-03-15T05:49:32.422 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDRKDBi75yNGRAADpXxnCnJc+Tt79UY6YRV2w== 2022-03-15T05:49:32.422 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.2] 2022-03-15T05:49:32.422 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDVKDBiMfS6AhAAn/R8aqyb4JOJcox5LhMRGw== 2022-03-15T05:49:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.3] 2022-03-15T05:49:32.423 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDYKDBiuB6dKBAAIVhQk8yne1JHTXX3o9AsTA== 2022-03-15T05:49:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:[mgr.x] 2022-03-15T05:49:32.423 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDIKDBi1tELOxAAD5AaqTgOMHEIUY6xF+JNdw== 2022-03-15T05:49:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b] 2022-03-15T05:49:32.424 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDJKDBi05XhLBAAR1tT+1poXo9SpUYfoDqOnw== 2022-03-15T05:49:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d] 2022-03-15T05:49:32.424 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDJKDBiIaQ3NBAAdWQpFOjboJoZzbqXDBG74A== 2022-03-15T05:49:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.f] 2022-03-15T05:49:32.425 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDJKDBiBr5DOxAABBk2KSygx/+IWiWckUUPfw== 2022-03-15T05:49:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.4] 2022-03-15T05:49:32.425 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDfKDBiNsIsEBAA5t+DkkbZFOg17nQRVnyuQA== 2022-03-15T05:49:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.5] 2022-03-15T05:49:32.426 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDiKDBi3xvWERAASlOhZramW8shUNVwt5ULzw== 2022-03-15T05:49:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.6] 2022-03-15T05:49:32.426 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDlKDBiIvi2EBAAas+gIgyV/aaTBsHtRg+Imw== 2022-03-15T05:49:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:[osd.7] 2022-03-15T05:49:32.427 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDoKDBi0Pm5DxAAWMvD7YMKie1leBnUxuqRWw== 2022-03-15T05:49:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2022-03-15T05:49:32.427 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQDKKDBiRIr4BxAAs6d3G/aTcYTVQrT3W38Lwg== 2022-03-15T05:49:32.465 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2022-03-15T05:49:32.465 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDIKDBintaxNhAALXikcUhAfZE1IizuQjJ4Bw== 2022-03-15T05:49:32.465 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2022-03-15T05:49:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDJKDBir5EfCBAAmY7/02rcKdNZA999quCtgA== 2022-03-15T05:49:32.466 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2022-03-15T05:49:32.466 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDJKDBiRKj7FRAArf6WkwaWOc5ciJ2JY1NjWA== 2022-03-15T05:49:32.467 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.e] 2022-03-15T05:49:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDJKDBiqGvUIxAACrFMpZ4JLbsqOS7dnF5hAQ== 2022-03-15T05:49:32.467 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2022-03-15T05:49:32.467 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDNKDBiCArzLRAAibEPDLVxdBEarPyZC0rl5w== 2022-03-15T05:49:32.467 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2022-03-15T05:49:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDRKDBi75yNGRAADpXxnCnJc+Tt79UY6YRV2w== 2022-03-15T05:49:32.468 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2022-03-15T05:49:32.468 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDVKDBiMfS6AhAAn/R8aqyb4JOJcox5LhMRGw== 2022-03-15T05:49:32.468 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2022-03-15T05:49:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDYKDBiuB6dKBAAIVhQk8yne1JHTXX3o9AsTA== 2022-03-15T05:49:32.469 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2022-03-15T05:49:32.469 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDIKDBi1tELOxAAD5AaqTgOMHEIUY6xF+JNdw== 2022-03-15T05:49:32.469 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2022-03-15T05:49:32.470 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDJKDBi05XhLBAAR1tT+1poXo9SpUYfoDqOnw== 2022-03-15T05:49:32.470 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2022-03-15T05:49:32.470 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDJKDBiIaQ3NBAAdWQpFOjboJoZzbqXDBG74A== 2022-03-15T05:49:32.470 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.f] 2022-03-15T05:49:32.470 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDJKDBiBr5DOxAABBk2KSygx/+IWiWckUUPfw== 2022-03-15T05:49:32.471 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2022-03-15T05:49:32.471 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDfKDBiNsIsEBAA5t+DkkbZFOg17nQRVnyuQA== 2022-03-15T05:49:32.471 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2022-03-15T05:49:32.471 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDiKDBi3xvWERAASlOhZramW8shUNVwt5ULzw== 2022-03-15T05:49:32.472 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2022-03-15T05:49:32.472 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDlKDBiIvi2EBAAas+gIgyV/aaTBsHtRg+Imw== 2022-03-15T05:49:32.472 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2022-03-15T05:49:32.472 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDoKDBi0Pm5DxAAWMvD7YMKie1leBnUxuqRWw== 2022-03-15T05:49:32.473 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2022-03-15T05:49:32.473 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDKKDBiRIr4BxAAs6d3G/aTcYTVQrT3W38Lwg== 2022-03-15T05:49:32.474 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-03-15T05:49:32.479 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-03-15T05:49:32.592 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:32.597 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:32.713 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:32.717 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:32.834 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:32.840 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:32.956 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:32.961 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:33.074 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:33.079 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:33.193 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:33.198 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:33.311 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:33.316 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:33.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-03-15T05:49:33.435 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2022-03-15T05:49:33.549 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:33.554 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:33.671 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:33.676 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:33.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:33.797 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2022-03-15T05:49:33.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:33.918 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:34.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:34.036 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:34.151 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:34.155 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:34.269 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:34.274 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2022-03-15T05:49:34.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-03-15T05:49:34.392 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2022-03-15T05:49:34.508 INFO:tasks.ceph:Running mkfs on mon nodes... 2022-03-15T05:49:34.509 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2022-03-15T05:49:34.589 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-03-15T05:49:34.726 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2022-03-15T05:49:34.807 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2022-03-15T05:49:34.835 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-03-15T05:49:34.930 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2022-03-15T05:49:34.956 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2022-03-15T05:49:35.022 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2022-03-15T05:49:35.114 DEBUG:teuthology.orchestra.run.smithi164:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2022-03-15T05:49:35.141 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:49:35.146 DEBUG:teuthology.orchestra.run.smithi164:> rm -- /home/ubuntu/cephtest/ceph.monmap 2022-03-15T05:49:35.198 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2022-03-15T05:49:35.198 INFO:tasks.ceph.mon.a:Restarting daemon 2022-03-15T05:49:35.199 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2022-03-15T05:49:35.204 INFO:tasks.ceph.mon.a:Started 2022-03-15T05:49:35.204 INFO:tasks.ceph.mon.b:Restarting daemon 2022-03-15T05:49:35.205 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2022-03-15T05:49:35.239 INFO:tasks.ceph.mon.b:Started 2022-03-15T05:49:35.240 INFO:tasks.ceph.mon.c:Restarting daemon 2022-03-15T05:49:35.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2022-03-15T05:49:35.243 INFO:tasks.ceph.mon.c:Started 2022-03-15T05:49:35.243 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2022-03-15T05:49:35.243 INFO:tasks.ceph.mgr.y:Restarting daemon 2022-03-15T05:49:35.244 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2022-03-15T05:49:35.248 INFO:tasks.ceph.mgr.y:Started 2022-03-15T05:49:35.249 INFO:tasks.ceph.mgr.x:Restarting daemon 2022-03-15T05:49:35.249 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2022-03-15T05:49:35.251 INFO:tasks.ceph.mgr.x:Started 2022-03-15T05:49:35.252 INFO:tasks.ceph:Setting crush tunables to default 2022-03-15T05:49:35.252 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd crush tunables default 2022-03-15T05:49:35.469 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.466+0000 7f37cb915700 1 Processor -- start 2022-03-15T05:49:35.470 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.466+0000 7f37cb915700 1 -- start start 2022-03-15T05:49:35.473 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.468+0000 7f37cb915700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4155800 0x7f37c40c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:35.473 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.468+0000 7f37cb915700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c40c5c70 con 0x7f37c4157df0 2022-03-15T05:49:35.473 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.469+0000 7f37c9eb2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4155800 0x7f37c40c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:35.474 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.469+0000 7f37c9eb2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4155800 0x7f37c40c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60002/0 (socket says 172.21.15.151:60002) 2022-03-15T05:49:35.474 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.469+0000 7f37c9eb2700 1 -- 172.21.15.151:0/2031898929 learned_addr learned my addr 172.21.15.151:0/2031898929 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:35.474 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.469+0000 7f37cb915700 1 -- 172.21.15.151:0/2031898929 --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c40c2920 con 0x7f37c4157a20 2022-03-15T05:49:35.474 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.469+0000 7f37c96b1700 1 --1- 172.21.15.151:0/2031898929 >> v1:172.21.15.164:6789/0 conn(0x7f37c4157a20 0x7f37c40cb050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33604/0 (socket says 172.21.15.151:33604) 2022-03-15T05:49:35.475 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.469+0000 7f37cb915700 1 -- 172.21.15.151:0/2031898929 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c40c34c0 con 0x7f37c4155800 2022-03-15T05:49:35.475 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.469+0000 7f37b3fff700 1 -- 172.21.15.151:0/2031898929 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218337082 0 0) 0x7f37c40c2920 con 0x7f37c4157a20 2022-03-15T05:49:35.475 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.469+0000 7f37c9eb2700 1 -- 172.21.15.151:0/2031898929 >> v1:172.21.15.164:6789/0 conn(0x7f37c4157a20 legacy=0x7f37c40cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:35.476 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.469+0000 7f37c9eb2700 1 -- 172.21.15.151:0/2031898929 >> v1:172.21.15.151:6789/0 conn(0x7f37c4157df0 legacy=0x7f37c40c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:35.476 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.469+0000 7f37c9eb2700 1 -- 172.21.15.151:0/2031898929 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c40cb850 con 0x7f37c4155800 2022-03-15T05:49:35.476 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.470+0000 7f37c9eb2700 1 --2- 172.21.15.151:0/2031898929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4155800 0x7f37c40c4b10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009f50 tx=0x7f37bc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf0e9ffad61b146f server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:35.476 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.470+0000 7f37b3fff700 1 -- 172.21.15.151:0/2031898929 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc00e070 con 0x7f37c4155800 2022-03-15T05:49:35.477 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.470+0000 7f37b3fff700 1 -- 172.21.15.151:0/2031898929 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc00bab0 con 0x7f37c4155800 2022-03-15T05:49:35.477 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.470+0000 7f37b3fff700 1 -- 172.21.15.151:0/2031898929 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0092e0 con 0x7f37c4155800 2022-03-15T05:49:35.481 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.471+0000 7f37cb915700 1 -- 172.21.15.151:0/2031898929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4155800 msgr2=0x7f37c40c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:35.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.471+0000 7f37cb915700 1 --2- 172.21.15.151:0/2031898929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4155800 0x7f37c40c4b10 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f37bc009f50 tx=0x7f37bc009840 comp rx=0 tx=0).stop 2022-03-15T05:49:35.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.471+0000 7f37cb915700 1 -- 172.21.15.151:0/2031898929 shutdown_connections 2022-03-15T05:49:35.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.471+0000 7f37cb915700 1 --2- 172.21.15.151:0/2031898929 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4155800 0x7f37c40c4b10 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:35.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.471+0000 7f37cb915700 1 -- 172.21.15.151:0/2031898929 >> 172.21.15.151:0/2031898929 conn(0x7f37c4068ec0 msgr2=0x7f37c40692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:35.483 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.471+0000 7f37cb915700 1 -- 172.21.15.151:0/2031898929 shutdown_connections 2022-03-15T05:49:35.483 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.471+0000 7f37cb915700 1 -- 172.21.15.151:0/2031898929 wait complete. 2022-03-15T05:49:35.483 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.474+0000 7f37cb915700 1 Processor -- start 2022-03-15T05:49:35.483 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.474+0000 7f37cb915700 1 -- start start 2022-03-15T05:49:35.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.475+0000 7f37cb915700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c4155800 0x7f37c41685e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:35.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.475+0000 7f37cb915700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37c4157a20 0x7f37c4165960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:35.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.475+0000 7f37cb915700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4157df0 0x7f37c4164ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:35.485 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.475+0000 7f37cb915700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c4168150 con 0x7f37c4157a20 2022-03-15T05:49:35.485 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.475+0000 7f37cb915700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c4155430 con 0x7f37c4155800 2022-03-15T05:49:35.485 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.475+0000 7f37cb915700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c4153f90 con 0x7f37c4157df0 2022-03-15T05:49:35.485 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c8eb0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37c4157a20 0x7f37c4165960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:35.486 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c96b1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c4155800 0x7f37c41685e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:35.486 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c9eb2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4157df0 0x7f37c4164ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:35.486 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c8eb0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37c4157a20 0x7f37c4165960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59886/0 (socket says 172.21.15.151:59886) 2022-03-15T05:49:35.486 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c8eb0700 1 -- 172.21.15.151:0/3394544821 learned_addr learned my addr 172.21.15.151:0/3394544821 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:35.487 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c8eb0700 1 -- 172.21.15.151:0/3394544821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4157df0 msgr2=0x7f37c4164ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:35.487 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c8eb0700 1 --2- 172.21.15.151:0/3394544821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4157df0 0x7f37c4164ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:35.487 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c8eb0700 1 -- 172.21.15.151:0/3394544821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c4155800 msgr2=0x7f37c41685e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:35.487 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c8eb0700 1 --2- 172.21.15.151:0/3394544821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c4155800 0x7f37c41685e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:35.488 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c8eb0700 1 -- 172.21.15.151:0/3394544821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc009ae0 con 0x7f37c4157a20 2022-03-15T05:49:35.488 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.476+0000 7f37c96b1700 1 --2- 172.21.15.151:0/3394544821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c4155800 0x7f37c41685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:35.488 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.477+0000 7f37c8eb0700 1 --2- 172.21.15.151:0/3394544821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37c4157a20 0x7f37c4165960 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f37b400c4c0 tx=0x7f37b4007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:35.489 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.477+0000 7f37b17fa700 1 -- 172.21.15.151:0/3394544821 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40050d0 con 0x7f37c4157a20 2022-03-15T05:49:35.489 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.477+0000 7f37b17fa700 1 -- 172.21.15.151:0/3394544821 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b4005230 con 0x7f37c4157a20 2022-03-15T05:49:35.489 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.477+0000 7f37cb915700 1 -- 172.21.15.151:0/3394544821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c4154270 con 0x7f37c4157a20 2022-03-15T05:49:35.489 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.477+0000 7f37b17fa700 1 -- 172.21.15.151:0/3394544821 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b40117e0 con 0x7f37c4157a20 2022-03-15T05:49:35.489 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.477+0000 7f37cb915700 1 -- 172.21.15.151:0/3394544821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c4167de0 con 0x7f37c4157a20 2022-03-15T05:49:35.490 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.477+0000 7f37b17fa700 1 -- 172.21.15.151:0/3394544821 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f37b4019030 con 0x7f37c4157a20 2022-03-15T05:49:35.490 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.478+0000 7f37b17fa700 1 -- 172.21.15.151:0/3394544821 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f37b4003a80 con 0x7f37c4157a20 2022-03-15T05:49:35.490 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.478+0000 7f37cb915700 1 -- 172.21.15.151:0/3394544821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c41682c0 con 0x7f37c4157a20 2022-03-15T05:49:35.491 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.481+0000 7f37b17fa700 1 -- 172.21.15.151:0/3394544821 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f37b4017070 con 0x7f37c4157a20 2022-03-15T05:49:35.561 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.559+0000 7f37cb915700 1 -- 172.21.15.151:0/3394544821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f37c40cbb30 con 0x7f37c4157a20 2022-03-15T05:49:35.565 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.562+0000 7f37b17fa700 1 -- 172.21.15.151:0/3394544821 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f37b4003c40 con 0x7f37c4157a20 2022-03-15T05:49:35.566 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.563+0000 7f37cb915700 1 -- 172.21.15.151:0/3394544821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37c4157a20 msgr2=0x7f37c4165960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:35.567 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.563+0000 7f37cb915700 1 --2- 172.21.15.151:0/3394544821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37c4157a20 0x7f37c4165960 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f37b400c4c0 tx=0x7f37b4007e00 comp rx=0 tx=0).stop 2022-03-15T05:49:35.567 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.563+0000 7f37cb915700 1 -- 172.21.15.151:0/3394544821 shutdown_connections 2022-03-15T05:49:35.567 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.563+0000 7f37cb915700 1 --2- 172.21.15.151:0/3394544821 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f37c4157df0 0x7f37c4164ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:35.568 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.563+0000 7f37cb915700 1 --2- 172.21.15.151:0/3394544821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f37c4155800 0x7f37c41685e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:35.568 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.563+0000 7f37cb915700 1 --2- 172.21.15.151:0/3394544821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f37c4157a20 0x7f37c4165960 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:35.568 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.563+0000 7f37cb915700 1 -- 172.21.15.151:0/3394544821 >> 172.21.15.151:0/3394544821 conn(0x7f37c4068ec0 msgr2=0x7f37c40c99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:35.569 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.563+0000 7f37cb915700 1 -- 172.21.15.151:0/3394544821 shutdown_connections 2022-03-15T05:49:35.569 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:35.563+0000 7f37cb915700 1 -- 172.21.15.151:0/3394544821 wait complete. 2022-03-15T05:49:35.570 INFO:teuthology.orchestra.run.smithi151.stderr:adjusted tunables profile to default 2022-03-15T05:49:35.589 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2022-03-15T05:49:35.590 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:35.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2022-03-15T05:49:35.608 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:35.605+0000 7f375a296000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-03-15T05:49:35.634 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:35.632+0000 7f4652c96000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2022-03-15T05:49:35.670 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:35.671 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2022-03-15T05:49:35.751 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:35.752 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2022-03-15T05:49:35.832 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2022-03-15T05:49:35.833 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2022-03-15T05:49:35.917 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:35.918 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2022-03-15T05:49:35.944 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:35.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2022-03-15T05:49:36.022 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:36.022 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2022-03-15T05:49:36.087 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2022-03-15T05:49:36.088 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2022-03-15T05:49:36.148 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:36.145+0000 7f4652c96000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-03-15T05:49:36.153 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd 0 2022-03-15T05:49:36.294 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:36.291+0000 7f375a296000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2022-03-15T05:49:36.310 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.307+0000 7f722463e700 1 Processor -- start 2022-03-15T05:49:36.310 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.307+0000 7f722463e700 1 -- start start 2022-03-15T05:49:36.313 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f722463e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f721c14cd00 0x7f721c0c7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.314 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f722463e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c06e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.314 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f722463e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f721c0c7980 con 0x7f721c14d0d0 2022-03-15T05:49:36.314 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f722463e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f721c152be0 con 0x7f721c14cd00 2022-03-15T05:49:36.314 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f722463e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c0c0060 con 0x7f721c0c0d40 2022-03-15T05:49:36.315 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f7221bd9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c06e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.315 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f72223da700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f721c14cd00 0x7f721c0c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.315 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f7222bdb700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f721c14d0d0 0x7f721c153030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55740/0 (socket says 172.21.15.164:55740) 2022-03-15T05:49:36.315 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f72223da700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f721c14cd00 0x7f721c0c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54410/0 (socket says 172.21.15.164:54410) 2022-03-15T05:49:36.316 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f7221bd9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c06e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44514/0 (socket says 172.21.15.164:44514) 2022-03-15T05:49:36.316 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.308+0000 7f7222bdb700 1 -- 172.21.15.164:0/2967543648 learned_addr learned my addr 172.21.15.164:0/2967543648 (peer_addr_for_me v1:172.21.15.164:0/0) 2022-03-15T05:49:36.316 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.309+0000 7f72223da700 1 -- 172.21.15.164:0/2967543648 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 msgr2=0x7f721c06e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:36.316 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.309+0000 7f72223da700 1 --2- 172.21.15.164:0/2967543648 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c06e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.317 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.309+0000 7f72223da700 1 -- 172.21.15.164:0/2967543648 >> v1:172.21.15.164:6789/0 conn(0x7f721c14d0d0 legacy=0x7f721c153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.317 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.309+0000 7f72223da700 1 -- 172.21.15.164:0/2967543648 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f721c0c0340 con 0x7f721c14cd00 2022-03-15T05:49:36.317 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.309+0000 7f72213d8700 1 -- 172.21.15.164:0/2967543648 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769760082 0 0) 0x7f721c0c7980 con 0x7f721c14d0d0 2022-03-15T05:49:36.317 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.309+0000 7f72223da700 1 --2- 172.21.15.164:0/2967543648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 0x7f721c0c7340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7214009e60 tx=0x7f7214009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3017c00e0e5d4a1 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:36.318 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.309+0000 7f72213d8700 1 -- 172.21.15.164:0/2967543648 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721400e070 con 0x7f721c14cd00 2022-03-15T05:49:36.318 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.309+0000 7f72213d8700 1 -- 172.21.15.164:0/2967543648 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721400bb60 con 0x7f721c14cd00 2022-03-15T05:49:36.318 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.309+0000 7f72213d8700 1 -- 172.21.15.164:0/2967543648 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214012430 con 0x7f721c14cd00 2022-03-15T05:49:36.318 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.310+0000 7f722463e700 1 -- 172.21.15.164:0/2967543648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 msgr2=0x7f721c0c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.319 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.310+0000 7f722463e700 1 --2- 172.21.15.164:0/2967543648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 0x7f721c0c7340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7214009e60 tx=0x7f7214009780 comp rx=0 tx=0).stop 2022-03-15T05:49:36.319 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.310+0000 7f722463e700 1 -- 172.21.15.164:0/2967543648 shutdown_connections 2022-03-15T05:49:36.319 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.310+0000 7f722463e700 1 --2- 172.21.15.164:0/2967543648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 0x7f721c0c7340 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.319 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.310+0000 7f722463e700 1 --2- 172.21.15.164:0/2967543648 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c06e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.320 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.310+0000 7f722463e700 1 -- 172.21.15.164:0/2967543648 >> 172.21.15.164:0/2967543648 conn(0x7f721c06aa60 msgr2=0x7f721c0c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:36.320 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.310+0000 7f722463e700 1 -- 172.21.15.164:0/2967543648 shutdown_connections 2022-03-15T05:49:36.320 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.310+0000 7f722463e700 1 -- 172.21.15.164:0/2967543648 wait complete. 2022-03-15T05:49:36.324 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.311+0000 7f722463e700 1 Processor -- start 2022-03-15T05:49:36.324 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.311+0000 7f722463e700 1 -- start start 2022-03-15T05:49:36.324 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f722463e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c14e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.324 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f722463e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 0x7f721c0c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.325 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f722463e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f721c14d0d0 0x7f721c155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.325 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f722463e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c14d5a0 con 0x7f721c14d0d0 2022-03-15T05:49:36.325 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f722463e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721c14d7f0 con 0x7f721c14cd00 2022-03-15T05:49:36.325 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f722463e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f721c14dad0 con 0x7f721c0c0d40 2022-03-15T05:49:36.326 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f7221bd9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 0x7f721c0c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.326 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f72223da700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c14e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.326 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f72223da700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c14e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44518/0 (socket says 172.21.15.164:44518) 2022-03-15T05:49:36.326 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f7221bd9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 0x7f721c0c5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54418/0 (socket says 172.21.15.164:54418) 2022-03-15T05:49:36.327 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.312+0000 7f72223da700 1 -- 172.21.15.164:0/2641451486 learned_addr learned my addr 172.21.15.164:0/2641451486 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-03-15T05:49:36.327 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f7222bdb700 1 --2- 172.21.15.164:0/2641451486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f721c14d0d0 0x7f721c155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.327 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f72223da700 1 -- 172.21.15.164:0/2641451486 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 msgr2=0x7f721c0c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.327 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f72223da700 1 --2- 172.21.15.164:0/2641451486 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 0x7f721c0c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.327 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f72223da700 1 -- 172.21.15.164:0/2641451486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f721c14d0d0 msgr2=0x7f721c155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.328 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f72223da700 1 --2- 172.21.15.164:0/2641451486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f721c14d0d0 0x7f721c155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.328 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f72223da700 1 -- 172.21.15.164:0/2641451486 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7214009a20 con 0x7f721c0c0d40 2022-03-15T05:49:36.328 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f7221bd9700 1 --2- 172.21.15.164:0/2641451486 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 0x7f721c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:36.328 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f7222bdb700 1 --2- 172.21.15.164:0/2641451486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f721c14d0d0 0x7f721c155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-15T05:49:36.329 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f72223da700 1 --2- 172.21.15.164:0/2641451486 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c14e890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f721c0c2e00 tx=0x7f7214019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:36.329 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f720a7fc700 1 -- 172.21.15.164:0/2641451486 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214003de0 con 0x7f721c0c0d40 2022-03-15T05:49:36.329 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f720a7fc700 1 -- 172.21.15.164:0/2641451486 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72140127a0 con 0x7f721c0c0d40 2022-03-15T05:49:36.329 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f720a7fc700 1 -- 172.21.15.164:0/2641451486 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7214012b60 con 0x7f721c0c0d40 2022-03-15T05:49:36.330 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f722463e700 1 -- 172.21.15.164:0/2641451486 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721c14ddb0 con 0x7f721c0c0d40 2022-03-15T05:49:36.330 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f722463e700 1 -- 172.21.15.164:0/2641451486 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f721c14e370 con 0x7f721c0c0d40 2022-03-15T05:49:36.330 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f720a7fc700 1 -- 172.21.15.164:0/2641451486 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f7214004040 con 0x7f721c0c0d40 2022-03-15T05:49:36.330 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.313+0000 7f720a7fc700 1 -- 172.21.15.164:0/2641451486 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7214027470 con 0x7f721c0c0d40 2022-03-15T05:49:36.331 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.314+0000 7f722463e700 1 -- 172.21.15.164:0/2641451486 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721c04b760 con 0x7f721c0c0d40 2022-03-15T05:49:36.331 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.316+0000 7f720a7fc700 1 -- 172.21.15.164:0/2641451486 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f721402c020 con 0x7f721c0c0d40 2022-03-15T05:49:36.399 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.396+0000 7f722463e700 1 -- 172.21.15.164:0/2641451486 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd", "id": 0} v 0) v1 -- 0x7f721c0c0620 con 0x7f721c0c0d40 2022-03-15T05:49:36.402 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.400+0000 7f720a7fc700 1 -- 172.21.15.164:0/2641451486 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f72140044b0 con 0x7f721c0c0d40 2022-03-15T05:49:36.403 INFO:teuthology.orchestra.run.smithi164.stdout:0 2022-03-15T05:49:36.404 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.401+0000 7f722463e700 1 -- 172.21.15.164:0/2641451486 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 msgr2=0x7f721c14e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.404 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.401+0000 7f722463e700 1 --2- 172.21.15.164:0/2641451486 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c14e890 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f721c0c2e00 tx=0x7f7214019000 comp rx=0 tx=0).stop 2022-03-15T05:49:36.405 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.401+0000 7f722463e700 1 -- 172.21.15.164:0/2641451486 shutdown_connections 2022-03-15T05:49:36.405 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.401+0000 7f722463e700 1 --2- 172.21.15.164:0/2641451486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f721c14d0d0 0x7f721c155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.405 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.401+0000 7f722463e700 1 --2- 172.21.15.164:0/2641451486 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f721c0c0d40 0x7f721c14e890 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.405 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.401+0000 7f722463e700 1 --2- 172.21.15.164:0/2641451486 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f721c14cd00 0x7f721c0c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.406 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.401+0000 7f722463e700 1 -- 172.21.15.164:0/2641451486 >> 172.21.15.164:0/2641451486 conn(0x7f721c06aa60 msgr2=0x7f721c150a80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:36.406 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.401+0000 7f722463e700 1 -- 172.21.15.164:0/2641451486 shutdown_connections 2022-03-15T05:49:36.406 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.401+0000 7f722463e700 1 -- 172.21.15.164:0/2641451486 wait complete. 2022-03-15T05:49:36.415 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new d9741252-6fc3-4bf2-a843-831bfa48368d 1 2022-03-15T05:49:36.534 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.531+0000 7fe27434b700 1 Processor -- start 2022-03-15T05:49:36.535 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.531+0000 7fe27434b700 1 -- start start 2022-03-15T05:49:36.537 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.532+0000 7fe27434b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 0x7fe26c06c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.538 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.532+0000 7fe27434b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c1559d0 con 0x7fe26c0c30e0 2022-03-15T05:49:36.538 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.532+0000 7fe27434b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe26c154de0 con 0x7fe26c067090 2022-03-15T05:49:36.538 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.532+0000 7fe27434b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c062a20 con 0x7fe26c062490 2022-03-15T05:49:36.538 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2718e6700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fe26c067090 0x7fe26c151970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55750/0 (socket says 172.21.15.164:55750) 2022-03-15T05:49:36.539 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2718e6700 1 -- 172.21.15.164:0/2880203077 learned_addr learned my addr 172.21.15.164:0/2880203077 (peer_addr_for_me v1:172.21.15.164:0/0) 2022-03-15T05:49:36.539 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2728e8700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 0x7fe26c06c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.539 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2710e5700 1 -- 172.21.15.164:0/2880203077 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 323097720 0 0) 0x7fe26c154de0 con 0x7fe26c067090 2022-03-15T05:49:36.539 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2710e5700 1 -- 172.21.15.164:0/2880203077 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2540033f0 con 0x7fe26c067090 2022-03-15T05:49:36.539 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2728e8700 1 -- 172.21.15.164:0/2880203077 >> v1:172.21.15.164:6789/0 conn(0x7fe26c067090 legacy=0x7fe26c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.540 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2728e8700 1 -- 172.21.15.164:0/2880203077 >> v1:172.21.15.151:6789/0 conn(0x7fe26c0c30e0 legacy=0x7fe26c066980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.540 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2728e8700 1 -- 172.21.15.164:0/2880203077 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe26c1550a0 con 0x7fe26c062490 2022-03-15T05:49:36.540 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2728e8700 1 --2- 172.21.15.164:0/2880203077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 0x7fe26c06c4c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe264009e90 tx=0x7fe264009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20d3b4eed2c8fd69 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:36.540 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2710e5700 1 -- 172.21.15.164:0/2880203077 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26400e070 con 0x7fe26c062490 2022-03-15T05:49:36.541 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2710e5700 1 -- 172.21.15.164:0/2880203077 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26400bc30 con 0x7fe26c062490 2022-03-15T05:49:36.541 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.533+0000 7fe2710e5700 1 -- 172.21.15.164:0/2880203077 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264012430 con 0x7fe26c062490 2022-03-15T05:49:36.541 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.534+0000 7fe27434b700 1 -- 172.21.15.164:0/2880203077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 msgr2=0x7fe26c06c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.541 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.534+0000 7fe27434b700 1 --2- 172.21.15.164:0/2880203077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 0x7fe26c06c4c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe264009e90 tx=0x7fe264009780 comp rx=0 tx=0).stop 2022-03-15T05:49:36.541 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.534+0000 7fe27434b700 1 -- 172.21.15.164:0/2880203077 shutdown_connections 2022-03-15T05:49:36.542 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.534+0000 7fe27434b700 1 --2- 172.21.15.164:0/2880203077 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 0x7fe26c06c4c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.542 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.534+0000 7fe27434b700 1 -- 172.21.15.164:0/2880203077 >> 172.21.15.164:0/2880203077 conn(0x7fe26c0c49d0 msgr2=0x7fe26c069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:36.542 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.534+0000 7fe27434b700 1 -- 172.21.15.164:0/2880203077 shutdown_connections 2022-03-15T05:49:36.542 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.534+0000 7fe27434b700 1 -- 172.21.15.164:0/2880203077 wait complete. 2022-03-15T05:49:36.542 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.535+0000 7fe27434b700 1 Processor -- start 2022-03-15T05:49:36.543 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.535+0000 7fe27434b700 1 -- start start 2022-03-15T05:49:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe27434b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 0x7fe26c14f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.545 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe27434b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe26c067090 0x7fe26c067a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe27434b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe26c0c30e0 0x7fe26c067f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe27434b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c158c70 con 0x7fe26c067090 2022-03-15T05:49:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe27434b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c14fc00 con 0x7fe26c0c30e0 2022-03-15T05:49:36.546 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe27434b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe26c162be0 con 0x7fe26c062490 2022-03-15T05:49:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2728e8700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe26c0c30e0 0x7fe26c067f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2728e8700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe26c0c30e0 0x7fe26c067f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54432/0 (socket says 172.21.15.164:54432) 2022-03-15T05:49:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2728e8700 1 -- 172.21.15.164:0/1539520571 learned_addr learned my addr 172.21.15.164:0/1539520571 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-03-15T05:49:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2720e7700 1 --2- 172.21.15.164:0/1539520571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 0x7fe26c14f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.547 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2718e6700 1 --2- 172.21.15.164:0/1539520571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe26c067090 0x7fe26c067a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2728e8700 1 -- 172.21.15.164:0/1539520571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 msgr2=0x7fe26c14f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2728e8700 1 --2- 172.21.15.164:0/1539520571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 0x7fe26c14f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2728e8700 1 -- 172.21.15.164:0/1539520571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe26c067090 msgr2=0x7fe26c067a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2728e8700 1 --2- 172.21.15.164:0/1539520571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe26c067090 0x7fe26c067a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.548 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2728e8700 1 -- 172.21.15.164:0/1539520571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe264009a20 con 0x7fe26c0c30e0 2022-03-15T05:49:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe2728e8700 1 --2- 172.21.15.164:0/1539520571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe26c0c30e0 0x7fe26c067f70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe26400b6c0 tx=0x7fe264019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe25a7fc700 1 -- 172.21.15.164:0/1539520571 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264003e20 con 0x7fe26c0c30e0 2022-03-15T05:49:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe25a7fc700 1 -- 172.21.15.164:0/1539520571 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe264012a20 con 0x7fe26c0c30e0 2022-03-15T05:49:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe27434b700 1 -- 172.21.15.164:0/1539520571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe26c1625d0 con 0x7fe26c0c30e0 2022-03-15T05:49:36.549 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe25a7fc700 1 -- 172.21.15.164:0/1539520571 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264012dc0 con 0x7fe26c0c30e0 2022-03-15T05:49:36.550 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.536+0000 7fe27434b700 1 -- 172.21.15.164:0/1539520571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe26c0c0590 con 0x7fe26c0c30e0 2022-03-15T05:49:36.550 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.538+0000 7fe25a7fc700 1 -- 172.21.15.164:0/1539520571 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fe264004250 con 0x7fe26c0c30e0 2022-03-15T05:49:36.550 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.538+0000 7fe25a7fc700 1 -- 172.21.15.164:0/1539520571 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7fe264027950 con 0x7fe26c0c30e0 2022-03-15T05:49:36.550 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.538+0000 7fe27434b700 1 -- 172.21.15.164:0/1539520571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe26c162d70 con 0x7fe26c0c30e0 2022-03-15T05:49:36.551 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.540+0000 7fe25a7fc700 1 -- 172.21.15.164:0/1539520571 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7fe264046470 con 0x7fe26c0c30e0 2022-03-15T05:49:36.605 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:36.602+0000 7f4652c96000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-03-15T05:49:36.635 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.633+0000 7fe27434b700 1 -- 172.21.15.164:0/1539520571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d9741252-6fc3-4bf2-a843-831bfa48368d", "id": 1} v 0) v1 -- 0x7fe26c04b760 con 0x7fe26c0c30e0 2022-03-15T05:49:36.643 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.640+0000 7fe25a7fc700 1 -- 172.21.15.164:0/1539520571 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d9741252-6fc3-4bf2-a843-831bfa48368d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe264035030 con 0x7fe26c0c30e0 2022-03-15T05:49:36.643 INFO:teuthology.orchestra.run.smithi164.stdout:1 2022-03-15T05:49:36.645 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.641+0000 7fe27434b700 1 -- 172.21.15.164:0/1539520571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe26c0c30e0 msgr2=0x7fe26c067f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.645 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.641+0000 7fe27434b700 1 --2- 172.21.15.164:0/1539520571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe26c0c30e0 0x7fe26c067f70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe26400b6c0 tx=0x7fe264019000 comp rx=0 tx=0).stop 2022-03-15T05:49:36.645 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.641+0000 7fe27434b700 1 -- 172.21.15.164:0/1539520571 shutdown_connections 2022-03-15T05:49:36.645 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.641+0000 7fe27434b700 1 --2- 172.21.15.164:0/1539520571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe26c0c30e0 0x7fe26c067f70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.646 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.641+0000 7fe27434b700 1 --2- 172.21.15.164:0/1539520571 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe26c062490 0x7fe26c14f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.646 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.641+0000 7fe27434b700 1 --2- 172.21.15.164:0/1539520571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe26c067090 0x7fe26c067a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.646 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.642+0000 7fe27434b700 1 -- 172.21.15.164:0/1539520571 >> 172.21.15.164:0/1539520571 conn(0x7fe26c0c49d0 msgr2=0x7fe26c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:36.646 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.642+0000 7fe27434b700 1 -- 172.21.15.164:0/1539520571 shutdown_connections 2022-03-15T05:49:36.647 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.642+0000 7fe27434b700 1 -- 172.21.15.164:0/1539520571 wait complete. 2022-03-15T05:49:36.656 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 3ae506ea-a48a-4186-a0ff-0d9e6754eac2 2 2022-03-15T05:49:36.772 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.769+0000 7f9c9cf8d700 1 Processor -- start 2022-03-15T05:49:36.772 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.770+0000 7f9c9cf8d700 1 -- start start 2022-03-15T05:49:36.779 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.770+0000 7f9c9cf8d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9c980c1530 0x7f9c98152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.779 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.770+0000 7f9c9cf8d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980c3c10 con 0x7f9c980c88e0 2022-03-15T05:49:36.780 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.770+0000 7f9c9cf8d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c980c45d0 con 0x7f9c9806d4b0 2022-03-15T05:49:36.780 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.770+0000 7f9c9cf8d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c980c30d0 con 0x7f9c980c1530 2022-03-15T05:49:36.780 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c96d9d700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f9c9806d4b0 0x7f9c9815d430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55766/0 (socket says 172.21.15.164:55766) 2022-03-15T05:49:36.780 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c96d9d700 1 -- 172.21.15.164:0/3272310033 learned_addr learned my addr 172.21.15.164:0/3272310033 (peer_addr_for_me v1:172.21.15.164:0/0) 2022-03-15T05:49:36.780 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9659c700 1 --2- 172.21.15.164:0/3272310033 >> v2:172.21.15.151:3300/0 conn(0x7f9c980c1530 0x7f9c98152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2047112830 0 0) 0x7f9c980c45d0 con 0x7f9c9806d4b0 2022-03-15T05:49:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c7c0033f0 con 0x7f9c9806d4b0 2022-03-15T05:49:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 720377091 0 0) 0x7f9c7c0033f0 con 0x7f9c9806d4b0 2022-03-15T05:49:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 >> v2:172.21.15.151:3300/0 conn(0x7f9c980c1530 msgr2=0x7f9c98152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:36.781 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 --2- 172.21.15.164:0/3272310033 >> v2:172.21.15.151:3300/0 conn(0x7f9c980c1530 0x7f9c98152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.782 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 >> v1:172.21.15.151:6789/0 conn(0x7f9c980c88e0 legacy=0x7f9c98151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.782 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9806bb90 con 0x7f9c9806d4b0 2022-03-15T05:49:36.782 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1345219590 0 0) 0x7f9c900017f0 con 0x7f9c9806d4b0 2022-03-15T05:49:36.782 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 >> v1:172.21.15.164:6789/0 conn(0x7f9c9806d4b0 legacy=0x7f9c9815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.783 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c7c0038e0 0x7f9c7c003d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.783 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c7c004690 0x7f9c7c004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.783 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 0x7f9c7c00b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.783 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c980c30d0 con 0x7f9c7c0038e0 2022-03-15T05:49:36.783 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c00c010 con 0x7f9c7c005040 2022-03-15T05:49:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c00c1d0 con 0x7f9c7c004690 2022-03-15T05:49:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c9659c700 1 --2- 172.21.15.164:0/3272310033 >> v2:172.21.15.151:3300/0 conn(0x7f9c980c1530 0x7f9c98152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c96d9d700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 0x7f9c7c00b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.784 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.771+0000 7f9c95d9b700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c7c004690 0x7f9c7c004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.785 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c9659c700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c7c0038e0 0x7f9c7c003d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.785 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c96d9d700 1 -- 172.21.15.164:0/3272310033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c7c004690 msgr2=0x7f9c7c004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:36.785 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c96d9d700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c7c004690 0x7f9c7c004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.785 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c96d9d700 1 -- 172.21.15.164:0/3272310033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c7c0038e0 msgr2=0x7f9c7c003d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:36.785 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c96d9d700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c7c0038e0 0x7f9c7c003d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c96d9d700 1 -- 172.21.15.164:0/3272310033 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c0033f0 con 0x7f9c7c005040 2022-03-15T05:49:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c9659c700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c7c0038e0 0x7f9c7c003d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:49:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c96d9d700 1 -- 172.21.15.164:0/3272310033 reap_dead start 2022-03-15T05:49:36.786 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c96d9d700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 0x7f9c7c00b8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000c5c0 tx=0x7f9c98067400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=248c59f9e29d5768 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:36.787 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9000cdc0 con 0x7f9c7c005040 2022-03-15T05:49:36.787 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c90005b20 con 0x7f9c7c005040 2022-03-15T05:49:36.787 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c9559a700 1 -- 172.21.15.164:0/3272310033 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c900070d0 con 0x7f9c7c005040 2022-03-15T05:49:36.787 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3272310033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 msgr2=0x7f9c7c00b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.787 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.772+0000 7f9c9cf8d700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 0x7f9c7c00b8e0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000c5c0 tx=0x7f9c98067400 comp rx=0 tx=0).stop 2022-03-15T05:49:36.788 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.773+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3272310033 shutdown_connections 2022-03-15T05:49:36.788 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.773+0000 7f9c9cf8d700 1 --2- 172.21.15.164:0/3272310033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 0x7f9c7c00b8e0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.788 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.773+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3272310033 >> 172.21.15.164:0/3272310033 conn(0x7f9c980c7d20 msgr2=0x7f9c980c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:36.788 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.773+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3272310033 shutdown_connections 2022-03-15T05:49:36.788 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.773+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3272310033 wait complete. 2022-03-15T05:49:36.789 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c9cf8d700 1 Processor -- start 2022-03-15T05:49:36.789 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c9cf8d700 1 -- start start 2022-03-15T05:49:36.789 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c9cf8d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 0x7f9c98159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.789 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c9cf8d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9814bff0 0x7f9c9814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.789 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c9cf8d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c98162950 0x7f9c98162dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:36.790 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c9cf8d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98156240 con 0x7f9c9814bff0 2022-03-15T05:49:36.790 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c9cf8d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98166ab0 con 0x7f9c7c005040 2022-03-15T05:49:36.790 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c9cf8d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c98151550 con 0x7f9c98162950 2022-03-15T05:49:36.790 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c96d9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c98162950 0x7f9c98162dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.791 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c9659c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 0x7f9c98159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.791 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.774+0000 7f9c96d9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c98162950 0x7f9c98162dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44552/0 (socket says 172.21.15.164:44552) 2022-03-15T05:49:36.791 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c96d9d700 1 -- 172.21.15.164:0/3211231668 learned_addr learned my addr 172.21.15.164:0/3211231668 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-03-15T05:49:36.791 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c95d9b700 1 --2- 172.21.15.164:0/3211231668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9814bff0 0x7f9c9814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:36.791 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c96d9d700 1 -- 172.21.15.164:0/3211231668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 msgr2=0x7f9c98159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.792 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c96d9d700 1 --2- 172.21.15.164:0/3211231668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 0x7f9c98159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.792 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c96d9d700 1 -- 172.21.15.164:0/3211231668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9814bff0 msgr2=0x7f9c9814c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.792 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c96d9d700 1 --2- 172.21.15.164:0/3211231668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9814bff0 0x7f9c9814c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.792 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c96d9d700 1 -- 172.21.15.164:0/3211231668 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c980be400 con 0x7f9c98162950 2022-03-15T05:49:36.792 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c95d9b700 1 --2- 172.21.15.164:0/3211231668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9814bff0 0x7f9c9814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:49:36.793 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c96d9d700 1 --2- 172.21.15.164:0/3211231668 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c98162950 0x7f9c98162dc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000cbb0 tx=0x7f9c90013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:36.793 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c867fc700 1 -- 172.21.15.164:0/3211231668 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c900017f0 con 0x7f9c98162950 2022-03-15T05:49:36.793 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c867fc700 1 -- 172.21.15.164:0/3211231668 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c90004e30 con 0x7f9c98162950 2022-03-15T05:49:36.793 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3211231668 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c980be6c0 con 0x7f9c98162950 2022-03-15T05:49:36.793 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c867fc700 1 -- 172.21.15.164:0/3211231668 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90007880 con 0x7f9c98162950 2022-03-15T05:49:36.794 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3211231668 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c98166180 con 0x7f9c98162950 2022-03-15T05:49:36.794 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c867fc700 1 -- 172.21.15.164:0/3211231668 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f9c90010070 con 0x7f9c98162950 2022-03-15T05:49:36.794 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.775+0000 7f9c867fc700 1 -- 172.21.15.164:0/3211231668 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f9c90001f10 con 0x7f9c98162950 2022-03-15T05:49:36.794 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.776+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3211231668 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9804b760 con 0x7f9c98162950 2022-03-15T05:49:36.795 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.778+0000 7f9c867fc700 1 -- 172.21.15.164:0/3211231668 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f9c900056b0 con 0x7f9c98162950 2022-03-15T05:49:36.834 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:36.831+0000 7f375a296000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2022-03-15T05:49:36.864 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.861+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3211231668 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "3ae506ea-a48a-4186-a0ff-0d9e6754eac2", "id": 2} v 0) v1 -- 0x7f9c9804b760 con 0x7f9c98162950 2022-03-15T05:49:36.871 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.869+0000 7f9c867fc700 1 -- 172.21.15.164:0/3211231668 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ae506ea-a48a-4186-a0ff-0d9e6754eac2", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c9001e480 con 0x7f9c98162950 2022-03-15T05:49:36.872 INFO:teuthology.orchestra.run.smithi164.stdout:2 2022-03-15T05:49:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.870+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3211231668 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c98162950 msgr2=0x7f9c98162dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.870+0000 7f9c9cf8d700 1 --2- 172.21.15.164:0/3211231668 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c98162950 0x7f9c98162dc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9c9000cbb0 tx=0x7f9c90013000 comp rx=0 tx=0).stop 2022-03-15T05:49:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.870+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3211231668 shutdown_connections 2022-03-15T05:49:36.873 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.870+0000 7f9c9cf8d700 1 --2- 172.21.15.164:0/3211231668 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9c98162950 0x7f9c98162dc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.870+0000 7f9c9cf8d700 1 --2- 172.21.15.164:0/3211231668 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9c7c005040 0x7f9c98159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.870+0000 7f9c9cf8d700 1 --2- 172.21.15.164:0/3211231668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c9814bff0 0x7f9c9814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.870+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3211231668 >> 172.21.15.164:0/3211231668 conn(0x7f9c980c7d20 msgr2=0x7f9c98068310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:36.874 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.870+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3211231668 shutdown_connections 2022-03-15T05:49:36.875 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:36.870+0000 7f9c9cf8d700 1 -- 172.21.15.164:0/3211231668 wait complete. 2022-03-15T05:49:36.878 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:36.875+0000 7f4652c96000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-03-15T05:49:36.884 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2 3 2022-03-15T05:49:36.961 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:36.958+0000 7f4652c96000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-03-15T05:49:37.003 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.000+0000 7f5a5c9f6700 1 Processor -- start 2022-03-15T05:49:37.003 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.000+0000 7f5a5c9f6700 1 -- start start 2022-03-15T05:49:37.005 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.001+0000 7f5a5c9f6700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5a580c2d80 0x7f5a58154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.006 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.001+0000 7f5a5c9f6700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5a5806bb60 0x7f5a58152600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.006 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.001+0000 7f5a5c9f6700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a58068ab0 con 0x7f5a5806ece0 2022-03-15T05:49:37.006 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.001+0000 7f5a5c9f6700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a580675c0 con 0x7f5a580c2d80 2022-03-15T05:49:37.007 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.001+0000 7f5a5c9f6700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a5806b350 con 0x7f5a5806bb60 2022-03-15T05:49:37.007 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.001+0000 7f5a56d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f5a5806bb60 0x7f5a58152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.007 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.001+0000 7f5a55d9b700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f5a5806ece0 0x7f5a58151ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55780/0 (socket says 172.21.15.164:55780) 2022-03-15T05:49:37.007 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.001+0000 7f5a55d9b700 1 -- 172.21.15.164:0/919843250 learned_addr learned my addr 172.21.15.164:0/919843250 (peer_addr_for_me v1:172.21.15.164:0/0) 2022-03-15T05:49:37.007 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.001+0000 7f5a5659c700 1 --2- 172.21.15.164:0/919843250 >> v2:172.21.15.151:3300/0 conn(0x7f5a580c2d80 0x7f5a58154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a56d9d700 1 -- 172.21.15.164:0/919843250 >> v2:172.21.15.151:3300/0 conn(0x7f5a580c2d80 msgr2=0x7f5a58154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a56d9d700 1 --2- 172.21.15.164:0/919843250 >> v2:172.21.15.151:3300/0 conn(0x7f5a580c2d80 0x7f5a58154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a56d9d700 1 -- 172.21.15.164:0/919843250 >> v1:172.21.15.164:6789/0 conn(0x7f5a5806ece0 legacy=0x7f5a58151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a56d9d700 1 -- 172.21.15.164:0/919843250 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a58066da0 con 0x7f5a5806bb60 2022-03-15T05:49:37.008 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a5559a700 1 -- 172.21.15.164:0/919843250 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3606798642 0 0) 0x7f5a58068ab0 con 0x7f5a5806ece0 2022-03-15T05:49:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a56d9d700 1 --2- 172.21.15.164:0/919843250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 0x7f5a58152600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5a58155db0 tx=0x7f5a50009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8dd6bcbfe2dfbe8 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a5559a700 1 -- 172.21.15.164:0/919843250 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5000e070 con 0x7f5a5806bb60 2022-03-15T05:49:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a5559a700 1 -- 172.21.15.164:0/919843250 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5000bc30 con 0x7f5a5806bb60 2022-03-15T05:49:37.009 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a5559a700 1 -- 172.21.15.164:0/919843250 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50012430 con 0x7f5a5806bb60 2022-03-15T05:49:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/919843250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 msgr2=0x7f5a58152600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a5c9f6700 1 --2- 172.21.15.164:0/919843250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 0x7f5a58152600 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5a58155db0 tx=0x7f5a50009780 comp rx=0 tx=0).stop 2022-03-15T05:49:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.002+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/919843250 shutdown_connections 2022-03-15T05:49:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.003+0000 7f5a5c9f6700 1 --2- 172.21.15.164:0/919843250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 0x7f5a58152600 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.010 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.003+0000 7f5a5c9f6700 1 --2- 172.21.15.164:0/919843250 >> v2:172.21.15.151:3300/0 conn(0x7f5a580c2d80 0x7f5a58154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.003+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/919843250 >> 172.21.15.164:0/919843250 conn(0x7f5a580c7d20 msgr2=0x7f5a580c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.003+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/919843250 shutdown_connections 2022-03-15T05:49:37.011 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.003+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/919843250 wait complete. 2022-03-15T05:49:37.014 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.004+0000 7f5a5c9f6700 1 Processor -- start 2022-03-15T05:49:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.004+0000 7f5a5c9f6700 1 -- start start 2022-03-15T05:49:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a5c9f6700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 0x7f5a58167a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a5c9f6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a5806ece0 0x7f5a5815a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.015 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a5c9f6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a580c2d80 0x7f5a5815a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a5c9f6700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a58158a10 con 0x7f5a5806ece0 2022-03-15T05:49:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a5c9f6700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5815bf30 con 0x7f5a5806bb60 2022-03-15T05:49:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a5c9f6700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5815bc90 con 0x7f5a580c2d80 2022-03-15T05:49:37.016 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a5659c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 0x7f5a58167a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a5659c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 0x7f5a58167a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54458/0 (socket says 172.21.15.164:54458) 2022-03-15T05:49:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a5659c700 1 -- 172.21.15.164:0/4286246890 learned_addr learned my addr 172.21.15.164:0/4286246890 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-03-15T05:49:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a56d9d700 1 --2- 172.21.15.164:0/4286246890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a580c2d80 0x7f5a5815a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a55d9b700 1 --2- 172.21.15.164:0/4286246890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a5806ece0 0x7f5a5815a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.017 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a56d9d700 1 -- 172.21.15.164:0/4286246890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 msgr2=0x7f5a58167a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a56d9d700 1 --2- 172.21.15.164:0/4286246890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 0x7f5a58167a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a56d9d700 1 -- 172.21.15.164:0/4286246890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a5806ece0 msgr2=0x7f5a5815a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a56d9d700 1 --2- 172.21.15.164:0/4286246890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a5806ece0 0x7f5a5815a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a56d9d700 1 -- 172.21.15.164:0/4286246890 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a50009a20 con 0x7f5a580c2d80 2022-03-15T05:49:37.018 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.005+0000 7f5a5659c700 1 --2- 172.21.15.164:0/4286246890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 0x7f5a58167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.006+0000 7f5a56d9d700 1 --2- 172.21.15.164:0/4286246890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a580c2d80 0x7f5a5815a7e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5a50016000 tx=0x7f5a50019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.006+0000 7f5a467fc700 1 -- 172.21.15.164:0/4286246890 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a50012e80 con 0x7f5a580c2d80 2022-03-15T05:49:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.006+0000 7f5a467fc700 1 -- 172.21.15.164:0/4286246890 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a500263f0 con 0x7f5a580c2d80 2022-03-15T05:49:37.019 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.006+0000 7f5a467fc700 1 -- 172.21.15.164:0/4286246890 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a500267b0 con 0x7f5a580c2d80 2022-03-15T05:49:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.006+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/4286246890 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5814ece0 con 0x7f5a580c2d80 2022-03-15T05:49:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.006+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/4286246890 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a580c70c0 con 0x7f5a580c2d80 2022-03-15T05:49:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.007+0000 7f5a467fc700 1 -- 172.21.15.164:0/4286246890 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f5a50026b60 con 0x7f5a580c2d80 2022-03-15T05:49:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.007+0000 7f5a467fc700 1 -- 172.21.15.164:0/4286246890 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f5a5001b890 con 0x7f5a580c2d80 2022-03-15T05:49:37.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.007+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/4286246890 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a5814ef20 con 0x7f5a580c2d80 2022-03-15T05:49:37.021 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.009+0000 7f5a467fc700 1 -- 172.21.15.164:0/4286246890 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f5a5814ef20 con 0x7f5a580c2d80 2022-03-15T05:49:37.041 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:37.039+0000 7f4652c96000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-03-15T05:49:37.092 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.090+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/4286246890 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2", "id": 3} v 0) v1 -- 0x7f5a581587e0 con 0x7f5a580c2d80 2022-03-15T05:49:37.098 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.096+0000 7f5a467fc700 1 -- 172.21.15.164:0/4286246890 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5a5001bb70 con 0x7f5a580c2d80 2022-03-15T05:49:37.099 INFO:teuthology.orchestra.run.smithi164.stdout:3 2022-03-15T05:49:37.100 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.097+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/4286246890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a580c2d80 msgr2=0x7f5a5815a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.101 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.097+0000 7f5a5c9f6700 1 --2- 172.21.15.164:0/4286246890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a580c2d80 0x7f5a5815a7e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f5a50016000 tx=0x7f5a50019000 comp rx=0 tx=0).stop 2022-03-15T05:49:37.101 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.097+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/4286246890 shutdown_connections 2022-03-15T05:49:37.101 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.097+0000 7f5a5c9f6700 1 --2- 172.21.15.164:0/4286246890 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5a580c2d80 0x7f5a5815a7e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.101 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.097+0000 7f5a5c9f6700 1 --2- 172.21.15.164:0/4286246890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5a5806bb60 0x7f5a58167a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.101 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.097+0000 7f5a5c9f6700 1 --2- 172.21.15.164:0/4286246890 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a5806ece0 0x7f5a5815a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.102 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.097+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/4286246890 >> 172.21.15.164:0/4286246890 conn(0x7f5a580c7d20 msgr2=0x7f5a580c6540 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:37.102 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.097+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/4286246890 shutdown_connections 2022-03-15T05:49:37.102 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.097+0000 7f5a5c9f6700 1 -- 172.21.15.164:0/4286246890 wait complete. 2022-03-15T05:49:37.116 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 2cd04560-8f2e-4cd2-997a-e79c8d2b9bef 4 2022-03-15T05:49:37.197 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:37.194+0000 7f375a296000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2022-03-15T05:49:37.232 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.230+0000 7f89e8e83700 1 Processor -- start 2022-03-15T05:49:37.233 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.230+0000 7f89e8e83700 1 -- start start 2022-03-15T05:49:37.235 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e8e83700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f89e40c3660 0x7f89e4155950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.235 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e8e83700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f89e406d590 0x7f89e406d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.236 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e8e83700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e406ae40 con 0x7f89e40c3290 2022-03-15T05:49:37.236 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e8e83700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e4155e90 con 0x7f89e40c3660 2022-03-15T05:49:37.236 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e8e83700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e406df10 con 0x7f89e406d590 2022-03-15T05:49:37.236 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e2d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f89e406d590 0x7f89e406d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.236 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e259c700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f89e40c3290 0x7f89e406e9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55792/0 (socket says 172.21.15.164:55792) 2022-03-15T05:49:37.237 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e259c700 1 -- 172.21.15.164:0/4096718585 learned_addr learned my addr 172.21.15.164:0/4096718585 (peer_addr_for_me v1:172.21.15.164:0/0) 2022-03-15T05:49:37.237 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e1d9b700 1 --2- 172.21.15.164:0/4096718585 >> v2:172.21.15.151:3300/0 conn(0x7f89e40c3660 0x7f89e4155950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.237 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e2d9d700 1 -- 172.21.15.164:0/4096718585 >> v2:172.21.15.151:3300/0 conn(0x7f89e40c3660 msgr2=0x7f89e4155950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:37.237 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e2d9d700 1 --2- 172.21.15.164:0/4096718585 >> v2:172.21.15.151:3300/0 conn(0x7f89e40c3660 0x7f89e4155950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e2d9d700 1 -- 172.21.15.164:0/4096718585 >> v1:172.21.15.164:6789/0 conn(0x7f89e40c3290 legacy=0x7f89e406e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e2d9d700 1 -- 172.21.15.164:0/4096718585 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e40c26b0 con 0x7f89e406d590 2022-03-15T05:49:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e1d9b700 1 --2- 172.21.15.164:0/4096718585 >> v2:172.21.15.151:3300/0 conn(0x7f89e40c3660 0x7f89e4155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-15T05:49:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e2d9d700 1 --2- 172.21.15.164:0/4096718585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 0x7f89e406d9d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f89e40c4790 tx=0x7f89dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58a19699cec7b807 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:37.238 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.231+0000 7f89e159a700 1 -- 172.21.15.164:0/4096718585 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc00bc30 con 0x7f89e406d590 2022-03-15T05:49:37.239 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.232+0000 7f89e159a700 1 -- 172.21.15.164:0/4096718585 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89dc00bd90 con 0x7f89e406d590 2022-03-15T05:49:37.239 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.232+0000 7f89e159a700 1 -- 172.21.15.164:0/4096718585 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89dc011690 con 0x7f89e406d590 2022-03-15T05:49:37.239 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.232+0000 7f89e8e83700 1 -- 172.21.15.164:0/4096718585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 msgr2=0x7f89e406d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.239 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.232+0000 7f89e8e83700 1 --2- 172.21.15.164:0/4096718585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 0x7f89e406d9d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f89e40c4790 tx=0x7f89dc009780 comp rx=0 tx=0).stop 2022-03-15T05:49:37.240 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.232+0000 7f89e8e83700 1 -- 172.21.15.164:0/4096718585 shutdown_connections 2022-03-15T05:49:37.240 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.232+0000 7f89e8e83700 1 --2- 172.21.15.164:0/4096718585 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 0x7f89e406d9d0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.240 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.232+0000 7f89e8e83700 1 --2- 172.21.15.164:0/4096718585 >> v2:172.21.15.151:3300/0 conn(0x7f89e40c3660 0x7f89e4155950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.240 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.232+0000 7f89e8e83700 1 -- 172.21.15.164:0/4096718585 >> 172.21.15.164:0/4096718585 conn(0x7f89e40c7d20 msgr2=0x7f89e40c8120 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:37.240 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.232+0000 7f89e8e83700 1 -- 172.21.15.164:0/4096718585 shutdown_connections 2022-03-15T05:49:37.241 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.232+0000 7f89e8e83700 1 -- 172.21.15.164:0/4096718585 wait complete. 2022-03-15T05:49:37.243 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.233+0000 7f89e8e83700 1 Processor -- start 2022-03-15T05:49:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.233+0000 7f89e8e83700 1 -- start start 2022-03-15T05:49:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e8e83700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 0x7f89e41579f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e8e83700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e40c3290 0x7f89e40a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.244 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e8e83700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89e40c3660 0x7f89e40a9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e8e83700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e4165000 con 0x7f89e40c3660 2022-03-15T05:49:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e8e83700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e40c2980 con 0x7f89e406d590 2022-03-15T05:49:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e8e83700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e41643a0 con 0x7f89e40c3290 2022-03-15T05:49:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e259c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 0x7f89e41579f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.245 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e259c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 0x7f89e41579f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54470/0 (socket says 172.21.15.164:54470) 2022-03-15T05:49:37.246 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e259c700 1 -- 172.21.15.164:0/2778933501 learned_addr learned my addr 172.21.15.164:0/2778933501 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-03-15T05:49:37.246 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e1d9b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e40c3290 0x7f89e40a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.246 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.234+0000 7f89e2d9d700 1 --2- 172.21.15.164:0/2778933501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89e40c3660 0x7f89e40a9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.246 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89e1d9b700 1 -- 172.21.15.164:0/2778933501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 msgr2=0x7f89e41579f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89e1d9b700 1 --2- 172.21.15.164:0/2778933501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 0x7f89e41579f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89e1d9b700 1 -- 172.21.15.164:0/2778933501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89e40c3660 msgr2=0x7f89e40a9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89e1d9b700 1 --2- 172.21.15.164:0/2778933501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89e40c3660 0x7f89e40a9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89e1d9b700 1 -- 172.21.15.164:0/2778933501 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc009a20 con 0x7f89e40c3290 2022-03-15T05:49:37.247 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89e259c700 1 --2- 172.21.15.164:0/2778933501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 0x7f89e41579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89e1d9b700 1 --2- 172.21.15.164:0/2778933501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e40c3290 0x7f89e40a98f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f89d800c880 tx=0x7f89d8008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89d27fc700 1 -- 172.21.15.164:0/2778933501 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8011600 con 0x7f89e40c3290 2022-03-15T05:49:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89d27fc700 1 -- 172.21.15.164:0/2778933501 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d8011760 con 0x7f89e40c3290 2022-03-15T05:49:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89e8e83700 1 -- 172.21.15.164:0/2778933501 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89e40c6dc0 con 0x7f89e40c3290 2022-03-15T05:49:37.248 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89d27fc700 1 -- 172.21.15.164:0/2778933501 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8011b20 con 0x7f89e40c3290 2022-03-15T05:49:37.249 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89e8e83700 1 -- 172.21.15.164:0/2778933501 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e4164940 con 0x7f89e40c3290 2022-03-15T05:49:37.249 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89d27fc700 1 -- 172.21.15.164:0/2778933501 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f89d8021070 con 0x7f89e40c3290 2022-03-15T05:49:37.249 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.235+0000 7f89d27fc700 1 -- 172.21.15.164:0/2778933501 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f89d8018870 con 0x7f89e40c3290 2022-03-15T05:49:37.249 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.236+0000 7f89e8e83700 1 -- 172.21.15.164:0/2778933501 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e404b760 con 0x7f89e40c3290 2022-03-15T05:49:37.249 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.238+0000 7f89d27fc700 1 -- 172.21.15.164:0/2778933501 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f89d8039470 con 0x7f89e40c3290 2022-03-15T05:49:37.308 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:37.305+0000 7f375a296000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2022-03-15T05:49:37.320 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.318+0000 7f89e8e83700 1 -- 172.21.15.164:0/2778933501 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2cd04560-8f2e-4cd2-997a-e79c8d2b9bef", "id": 4} v 0) v1 -- 0x7f89e406b100 con 0x7f89e40c3290 2022-03-15T05:49:37.326 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.323+0000 7f89d27fc700 1 -- 172.21.15.164:0/2778933501 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2cd04560-8f2e-4cd2-997a-e79c8d2b9bef", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f89d8028030 con 0x7f89e40c3290 2022-03-15T05:49:37.326 INFO:teuthology.orchestra.run.smithi164.stdout:4 2022-03-15T05:49:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.324+0000 7f89e8e83700 1 -- 172.21.15.164:0/2778933501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e40c3290 msgr2=0x7f89e40a98f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.324+0000 7f89e8e83700 1 --2- 172.21.15.164:0/2778933501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e40c3290 0x7f89e40a98f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f89d800c880 tx=0x7f89d8008040 comp rx=0 tx=0).stop 2022-03-15T05:49:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.324+0000 7f89e8e83700 1 -- 172.21.15.164:0/2778933501 shutdown_connections 2022-03-15T05:49:37.328 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.324+0000 7f89e8e83700 1 --2- 172.21.15.164:0/2778933501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89e40c3660 0x7f89e40a9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.329 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.324+0000 7f89e8e83700 1 --2- 172.21.15.164:0/2778933501 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89e406d590 0x7f89e41579f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.329 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.324+0000 7f89e8e83700 1 --2- 172.21.15.164:0/2778933501 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f89e40c3290 0x7f89e40a98f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.329 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.325+0000 7f89e8e83700 1 -- 172.21.15.164:0/2778933501 >> 172.21.15.164:0/2778933501 conn(0x7f89e40c7d20 msgr2=0x7f89e406e0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:37.329 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.325+0000 7f89e8e83700 1 -- 172.21.15.164:0/2778933501 shutdown_connections 2022-03-15T05:49:37.329 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.325+0000 7f89e8e83700 1 -- 172.21.15.164:0/2778933501 wait complete. 2022-03-15T05:49:37.339 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 2ef0ce5d-53d2-4270-8d2c-5a361f043243 5 2022-03-15T05:49:37.420 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:37.417+0000 7f375a296000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2022-03-15T05:49:37.434 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:37.431+0000 7f4652c96000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-03-15T05:49:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.454+0000 7f061d106700 1 Processor -- start 2022-03-15T05:49:37.457 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f061d106700 1 -- start start 2022-03-15T05:49:37.460 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f061d106700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0618155600 0x7f0618066980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f061d106700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f06180673f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f061d106700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06180685d0 con 0x7f0618062520 2022-03-15T05:49:37.461 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f061d106700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0618156560 con 0x7f0618155600 2022-03-15T05:49:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f061d106700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f061806d100 con 0x7f061806cae0 2022-03-15T05:49:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f0616d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0618155600 0x7f0618066980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f061759e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f06180673f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.462 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f0616d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f0618155600 0x7f0618066980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54476/0 (socket says 172.21.15.164:54476) 2022-03-15T05:49:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f061759e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f06180673f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44582/0 (socket says 172.21.15.164:44582) 2022-03-15T05:49:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.455+0000 7f0616d9d700 1 -- 172.21.15.164:0/3472003767 learned_addr learned my addr 172.21.15.164:0/3472003767 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-03-15T05:49:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.456+0000 7f0616d9d700 1 -- 172.21.15.164:0/3472003767 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 msgr2=0x7f06180673f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:37.463 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.456+0000 7f0616d9d700 1 --2- 172.21.15.164:0/3472003767 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f06180673f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.456+0000 7f0616d9d700 1 -- 172.21.15.164:0/3472003767 >> v1:172.21.15.151:6789/0 conn(0x7f0618062520 legacy=0x7f0618155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.456+0000 7f0616d9d700 1 -- 172.21.15.164:0/3472003767 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06180b73c0 con 0x7f0618155600 2022-03-15T05:49:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.456+0000 7f061759e700 1 --2- 172.21.15.164:0/3472003767 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f06180673f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:37.464 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.456+0000 7f0616d9d700 1 --2- 172.21.15.164:0/3472003767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0618155600 0x7f0618066980 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0608006fd0 tx=0x7f06080090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2fd3b9132b2eae server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.456+0000 7f0615d9b700 1 -- 172.21.15.164:0/3472003767 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608011630 con 0x7f0618155600 2022-03-15T05:49:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.456+0000 7f0615d9b700 1 -- 172.21.15.164:0/3472003767 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06080117b0 con 0x7f0618155600 2022-03-15T05:49:37.465 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.456+0000 7f0615d9b700 1 -- 172.21.15.164:0/3472003767 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0608011b70 con 0x7f0618155600 2022-03-15T05:49:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.457+0000 7f061d106700 1 -- 172.21.15.164:0/3472003767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0618155600 msgr2=0x7f0618066980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.457+0000 7f061d106700 1 --2- 172.21.15.164:0/3472003767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0618155600 0x7f0618066980 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f0608006fd0 tx=0x7f06080090f0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.457+0000 7f061d106700 1 -- 172.21.15.164:0/3472003767 shutdown_connections 2022-03-15T05:49:37.466 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.457+0000 7f061d106700 1 --2- 172.21.15.164:0/3472003767 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f06180673f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.467 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.457+0000 7f061d106700 1 --2- 172.21.15.164:0/3472003767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0618155600 0x7f0618066980 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.467 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.457+0000 7f061d106700 1 -- 172.21.15.164:0/3472003767 >> 172.21.15.164:0/3472003767 conn(0x7f06180c49d0 msgr2=0x7f0618069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:37.467 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.457+0000 7f061d106700 1 -- 172.21.15.164:0/3472003767 shutdown_connections 2022-03-15T05:49:37.467 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.457+0000 7f061d106700 1 -- 172.21.15.164:0/3472003767 wait complete. 2022-03-15T05:49:37.467 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.458+0000 7f061d106700 1 Processor -- start 2022-03-15T05:49:37.468 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.458+0000 7f061d106700 1 -- start start 2022-03-15T05:49:37.470 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061d106700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0618062520 0x7f06181596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061d106700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f0618165300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061d106700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0618155600 0x7f06180b63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061d106700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180bd420 con 0x7f0618062520 2022-03-15T05:49:37.471 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061d106700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06180b3fe0 con 0x7f0618155600 2022-03-15T05:49:37.472 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061d106700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06180b4250 con 0x7f061806cae0 2022-03-15T05:49:37.472 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061659c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f0618165300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.472 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061659c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f0618165300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44586/0 (socket says 172.21.15.164:44586) 2022-03-15T05:49:37.472 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061659c700 1 -- 172.21.15.164:0/1631203051 learned_addr learned my addr 172.21.15.164:0/1631203051 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-03-15T05:49:37.473 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061759e700 1 --2- 172.21.15.164:0/1631203051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0618155600 0x7f06180b63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.473 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f0616d9d700 1 --2- 172.21.15.164:0/1631203051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0618062520 0x7f06181596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.473 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061659c700 1 -- 172.21.15.164:0/1631203051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0618155600 msgr2=0x7f06180b63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.474 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061659c700 1 --2- 172.21.15.164:0/1631203051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0618155600 0x7f06180b63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.474 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061659c700 1 -- 172.21.15.164:0/1631203051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0618062520 msgr2=0x7f06181596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.474 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061659c700 1 --2- 172.21.15.164:0/1631203051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0618062520 0x7f06181596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.474 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061659c700 1 -- 172.21.15.164:0/1631203051 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0610009a20 con 0x7f061806cae0 2022-03-15T05:49:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061659c700 1 --2- 172.21.15.164:0/1631203051 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f0618165300 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f060c00b490 tx=0x7f060c006f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f05feffd700 1 -- 172.21.15.164:0/1631203051 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c011630 con 0x7f061806cae0 2022-03-15T05:49:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f05feffd700 1 -- 172.21.15.164:0/1631203051 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f060c011790 con 0x7f061806cae0 2022-03-15T05:49:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061d106700 1 -- 172.21.15.164:0/1631203051 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0608009370 con 0x7f061806cae0 2022-03-15T05:49:37.475 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f05feffd700 1 -- 172.21.15.164:0/1631203051 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060c011b50 con 0x7f061806cae0 2022-03-15T05:49:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.459+0000 7f061d106700 1 -- 172.21.15.164:0/1631203051 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0618164b00 con 0x7f061806cae0 2022-03-15T05:49:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.460+0000 7f05feffd700 1 -- 172.21.15.164:0/1631203051 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f060c021070 con 0x7f061806cae0 2022-03-15T05:49:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.460+0000 7f05feffd700 1 -- 172.21.15.164:0/1631203051 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f060c019930 con 0x7f061806cae0 2022-03-15T05:49:37.476 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.460+0000 7f061d106700 1 -- 172.21.15.164:0/1631203051 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f061804b760 con 0x7f061806cae0 2022-03-15T05:49:37.477 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.462+0000 7f05feffd700 1 -- 172.21.15.164:0/1631203051 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f060c039470 con 0x7f061806cae0 2022-03-15T05:49:37.511 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:37.509+0000 7f4652c96000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-03-15T05:49:37.546 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.544+0000 7f061d106700 1 -- 172.21.15.164:0/1631203051 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2ef0ce5d-53d2-4270-8d2c-5a361f043243", "id": 5} v 0) v1 -- 0x7f06180b76a0 con 0x7f061806cae0 2022-03-15T05:49:37.554 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.551+0000 7f05feffd700 1 -- 172.21.15.164:0/1631203051 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2ef0ce5d-53d2-4270-8d2c-5a361f043243", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f060c028070 con 0x7f061806cae0 2022-03-15T05:49:37.554 INFO:teuthology.orchestra.run.smithi164.stdout:5 2022-03-15T05:49:37.556 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.552+0000 7f061d106700 1 -- 172.21.15.164:0/1631203051 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 msgr2=0x7f0618165300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.556 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.552+0000 7f061d106700 1 --2- 172.21.15.164:0/1631203051 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f0618165300 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f060c00b490 tx=0x7f060c006f20 comp rx=0 tx=0).stop 2022-03-15T05:49:37.556 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.552+0000 7f061d106700 1 -- 172.21.15.164:0/1631203051 shutdown_connections 2022-03-15T05:49:37.557 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.552+0000 7f061d106700 1 --2- 172.21.15.164:0/1631203051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0618155600 0x7f06180b63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.557 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.552+0000 7f061d106700 1 --2- 172.21.15.164:0/1631203051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0618062520 0x7f06181596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.557 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.552+0000 7f061d106700 1 --2- 172.21.15.164:0/1631203051 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f061806cae0 0x7f0618165300 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.557 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.552+0000 7f061d106700 1 -- 172.21.15.164:0/1631203051 >> 172.21.15.164:0/1631203051 conn(0x7f06180c49d0 msgr2=0x7f0618152410 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:37.558 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.552+0000 7f061d106700 1 -- 172.21.15.164:0/1631203051 shutdown_connections 2022-03-15T05:49:37.558 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.553+0000 7f061d106700 1 -- 172.21.15.164:0/1631203051 wait complete. 2022-03-15T05:49:37.567 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 0c37ca28-6713-4176-8680-5fa03fe4d2d8 6 2022-03-15T05:49:37.623 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:37.620+0000 7f4652c96000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-03-15T05:49:37.683 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.680+0000 7f4f3d755700 1 Processor -- start 2022-03-15T05:49:37.683 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.680+0000 7f4f3d755700 1 -- start start 2022-03-15T05:49:37.686 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f3d755700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381526b0 0x7f4f38152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f3d755700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4f381546f0 0x7f4f38154b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f3d755700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3806c800 con 0x7f4f38154320 2022-03-15T05:49:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f3d755700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3806cae0 con 0x7f4f381546f0 2022-03-15T05:49:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f3d755700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f381550b0 con 0x7f4f381526b0 2022-03-15T05:49:37.687 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f367fc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381526b0 0x7f4f38152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f367fc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381526b0 0x7f4f38152ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44592/0 (socket says 172.21.15.164:44592) 2022-03-15T05:49:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f367fc700 1 -- 172.21.15.164:0/3835157922 learned_addr learned my addr 172.21.15.164:0/3835157922 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-03-15T05:49:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f367fc700 1 -- 172.21.15.164:0/3835157922 >> v2:172.21.15.151:3300/0 conn(0x7f4f381546f0 msgr2=0x7f4f38154b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:37.688 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f367fc700 1 --2- 172.21.15.164:0/3835157922 >> v2:172.21.15.151:3300/0 conn(0x7f4f381546f0 0x7f4f38154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f367fc700 1 -- 172.21.15.164:0/3835157922 >> v1:172.21.15.151:6789/0 conn(0x7f4f38154320 legacy=0x7f4f381517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f367fc700 1 -- 172.21.15.164:0/3835157922 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f38152220 con 0x7f4f381526b0 2022-03-15T05:49:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f367fc700 1 --2- 172.21.15.164:0/3835157922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381526b0 0x7f4f38152ac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c006fd0 tx=0x7f4f2c0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36d3c87eb8d1ad40 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f35ffb700 1 -- 172.21.15.164:0/3835157922 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c011630 con 0x7f4f381526b0 2022-03-15T05:49:37.689 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f35ffb700 1 -- 172.21.15.164:0/3835157922 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c0117b0 con 0x7f4f381526b0 2022-03-15T05:49:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.681+0000 7f4f35ffb700 1 -- 172.21.15.164:0/3835157922 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c011b70 con 0x7f4f381526b0 2022-03-15T05:49:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.682+0000 7f4f3d755700 1 -- 172.21.15.164:0/3835157922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381526b0 msgr2=0x7f4f38152ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.682+0000 7f4f3d755700 1 --2- 172.21.15.164:0/3835157922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381526b0 0x7f4f38152ac0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c006fd0 tx=0x7f4f2c0090f0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.690 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.682+0000 7f4f3d755700 1 -- 172.21.15.164:0/3835157922 shutdown_connections 2022-03-15T05:49:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.682+0000 7f4f3d755700 1 --2- 172.21.15.164:0/3835157922 >> v2:172.21.15.151:3300/0 conn(0x7f4f381546f0 0x7f4f38154b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.682+0000 7f4f3d755700 1 --2- 172.21.15.164:0/3835157922 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381526b0 0x7f4f38152ac0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.682+0000 7f4f3d755700 1 -- 172.21.15.164:0/3835157922 >> 172.21.15.164:0/3835157922 conn(0x7f4f380c49d0 msgr2=0x7f4f38069f90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:37.691 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.682+0000 7f4f3d755700 1 -- 172.21.15.164:0/3835157922 shutdown_connections 2022-03-15T05:49:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.682+0000 7f4f3d755700 1 -- 172.21.15.164:0/3835157922 wait complete. 2022-03-15T05:49:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.683+0000 7f4f3d755700 1 Processor -- start 2022-03-15T05:49:37.692 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.683+0000 7f4f3d755700 1 -- start start 2022-03-15T05:49:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f3d755700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f381526b0 0x7f4f380c2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f3d755700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f38154320 0x7f4f380c32b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.695 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f3d755700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381546f0 0x7f4f380c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f3d755700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380c6cd0 con 0x7f4f381526b0 2022-03-15T05:49:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f3d755700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f380c6f90 con 0x7f4f38154320 2022-03-15T05:49:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f3d755700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3814a0f0 con 0x7f4f381546f0 2022-03-15T05:49:37.696 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f367fc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f38154320 0x7f4f380c32b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f367fc700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f38154320 0x7f4f380c32b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54496/0 (socket says 172.21.15.164:54496) 2022-03-15T05:49:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f377fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381546f0 0x7f4f380c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f367fc700 1 -- 172.21.15.164:0/2120778143 learned_addr learned my addr 172.21.15.164:0/2120778143 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-03-15T05:49:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.684+0000 7f4f36ffd700 1 --2- 172.21.15.164:0/2120778143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f381526b0 0x7f4f380c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.697 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f377fe700 1 -- 172.21.15.164:0/2120778143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f38154320 msgr2=0x7f4f380c32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f377fe700 1 --2- 172.21.15.164:0/2120778143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f38154320 0x7f4f380c32b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f377fe700 1 -- 172.21.15.164:0/2120778143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f381526b0 msgr2=0x7f4f380c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f377fe700 1 --2- 172.21.15.164:0/2120778143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f381526b0 0x7f4f380c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f377fe700 1 -- 172.21.15.164:0/2120778143 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c009370 con 0x7f4f381546f0 2022-03-15T05:49:37.698 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f367fc700 1 --2- 172.21.15.164:0/2120778143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f38154320 0x7f4f380c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:37.699 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f36ffd700 1 --2- 172.21.15.164:0/2120778143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f381526b0 0x7f4f380c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:49:37.699 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f377fe700 1 --2- 172.21.15.164:0/2120778143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381546f0 0x7f4f380c37f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000b810 tx=0x7f4f30009270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:37.699 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f1effd700 1 -- 172.21.15.164:0/2120778143 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30010680 con 0x7f4f381546f0 2022-03-15T05:49:37.699 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f1effd700 1 -- 172.21.15.164:0/2120778143 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f30010800 con 0x7f4f381546f0 2022-03-15T05:49:37.700 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f3d755700 1 -- 172.21.15.164:0/2120778143 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3814a3d0 con 0x7f4f381546f0 2022-03-15T05:49:37.700 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f1effd700 1 -- 172.21.15.164:0/2120778143 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30010bc0 con 0x7f4f381546f0 2022-03-15T05:49:37.700 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f3d755700 1 -- 172.21.15.164:0/2120778143 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3814a990 con 0x7f4f381546f0 2022-03-15T05:49:37.700 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f1effd700 1 -- 172.21.15.164:0/2120778143 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7f4f30020070 con 0x7f4f381546f0 2022-03-15T05:49:37.700 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.685+0000 7f4f1effd700 1 -- 172.21.15.164:0/2120778143 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f4f300196d0 con 0x7f4f381546f0 2022-03-15T05:49:37.701 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.686+0000 7f4f3d755700 1 -- 172.21.15.164:0/2120778143 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3814ab80 con 0x7f4f381546f0 2022-03-15T05:49:37.701 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.688+0000 7f4f1effd700 1 -- 172.21.15.164:0/2120778143 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7f4f3001e060 con 0x7f4f381546f0 2022-03-15T05:49:37.701 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:37.693+0000 7f4652c96000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-03-15T05:49:37.771 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.768+0000 7f4f3d755700 1 -- 172.21.15.164:0/2120778143 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0c37ca28-6713-4176-8680-5fa03fe4d2d8", "id": 6} v 0) v1 -- 0x7f4f3804b760 con 0x7f4f381546f0 2022-03-15T05:49:37.778 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.776+0000 7f4f1effd700 1 -- 172.21.15.164:0/2120778143 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0c37ca28-6713-4176-8680-5fa03fe4d2d8", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4f30027020 con 0x7f4f381546f0 2022-03-15T05:49:37.779 INFO:teuthology.orchestra.run.smithi164.stdout:6 2022-03-15T05:49:37.780 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.777+0000 7f4f3d755700 1 -- 172.21.15.164:0/2120778143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381546f0 msgr2=0x7f4f380c37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.780 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.777+0000 7f4f3d755700 1 --2- 172.21.15.164:0/2120778143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381546f0 0x7f4f380c37f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f4f3000b810 tx=0x7f4f30009270 comp rx=0 tx=0).stop 2022-03-15T05:49:37.780 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.777+0000 7f4f3d755700 1 -- 172.21.15.164:0/2120778143 shutdown_connections 2022-03-15T05:49:37.781 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.777+0000 7f4f3d755700 1 --2- 172.21.15.164:0/2120778143 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4f381546f0 0x7f4f380c37f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.781 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.777+0000 7f4f3d755700 1 --2- 172.21.15.164:0/2120778143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f381526b0 0x7f4f380c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.781 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.777+0000 7f4f3d755700 1 --2- 172.21.15.164:0/2120778143 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f38154320 0x7f4f380c32b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.781 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.777+0000 7f4f3d755700 1 -- 172.21.15.164:0/2120778143 >> 172.21.15.164:0/2120778143 conn(0x7f4f380c49d0 msgr2=0x7f4f38150d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:37.782 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.777+0000 7f4f3d755700 1 -- 172.21.15.164:0/2120778143 shutdown_connections 2022-03-15T05:49:37.782 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.777+0000 7f4f3d755700 1 -- 172.21.15.164:0/2120778143 wait complete. 2022-03-15T05:49:37.791 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --cluster ceph osd new 3ed8d241-1f34-400f-b33e-a8cfb1132fca 7 2022-03-15T05:49:37.855 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:37.853+0000 7f4652c96000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-03-15T05:49:37.889 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:37.886+0000 7f375a296000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2022-03-15T05:49:37.908 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.906+0000 7fd952207700 1 Processor -- start 2022-03-15T05:49:37.908 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.906+0000 7fd952207700 1 -- start start 2022-03-15T05:49:37.911 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.906+0000 7fd952207700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd94c06c440 0x7fd94c155790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.911 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.906+0000 7fd952207700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c069620 0x7fd94c0c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.912 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.906+0000 7fd952207700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd94c067a90 con 0x7fd94c06c810 2022-03-15T05:49:37.912 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.906+0000 7fd952207700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd94c0c8e30 con 0x7fd94c06c440 2022-03-15T05:49:37.912 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.906+0000 7fd952207700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0c3f00 con 0x7fd94c069620 2022-03-15T05:49:37.912 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94b7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd94c06c440 0x7fd94c155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.913 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94affd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c069620 0x7fd94c0c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.913 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94bfff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fd94c06c810 0x7fd94c1541a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.164:55828/0 (socket says 172.21.15.164:55828) 2022-03-15T05:49:37.913 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94b7fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fd94c06c440 0x7fd94c155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54500/0 (socket says 172.21.15.164:54500) 2022-03-15T05:49:37.913 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94bfff700 1 -- 172.21.15.164:0/3451112619 learned_addr learned my addr 172.21.15.164:0/3451112619 (peer_addr_for_me v1:172.21.15.164:0/0) 2022-03-15T05:49:37.913 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94b7fe700 1 -- 172.21.15.164:0/3451112619 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c069620 msgr2=0x7fd94c0c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:37.914 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94b7fe700 1 --2- 172.21.15.164:0/3451112619 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c069620 0x7fd94c0c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.914 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94b7fe700 1 -- 172.21.15.164:0/3451112619 >> v1:172.21.15.164:6789/0 conn(0x7fd94c06c810 legacy=0x7fd94c1541a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.914 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94a7fc700 1 -- 172.21.15.164:0/3451112619 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980769825 0 0) 0x7fd94c067a90 con 0x7fd94c06c810 2022-03-15T05:49:37.914 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94b7fe700 1 -- 172.21.15.164:0/3451112619 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c067ce0 con 0x7fd94c06c440 2022-03-15T05:49:37.915 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94b7fe700 1 --2- 172.21.15.164:0/3451112619 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c440 0x7fd94c155790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009760 tx=0x7fd93c009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=536c809ea32fa57c server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:37.915 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94a7fc700 1 -- 172.21.15.164:0/3451112619 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c011630 con 0x7fd94c06c440 2022-03-15T05:49:37.915 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94a7fc700 1 -- 172.21.15.164:0/3451112619 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd93c011790 con 0x7fd94c06c440 2022-03-15T05:49:37.915 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.907+0000 7fd94a7fc700 1 -- 172.21.15.164:0/3451112619 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd93c011b50 con 0x7fd94c06c440 2022-03-15T05:49:37.916 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.908+0000 7fd952207700 1 -- 172.21.15.164:0/3451112619 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c440 msgr2=0x7fd94c155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.916 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.908+0000 7fd952207700 1 --2- 172.21.15.164:0/3451112619 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c440 0x7fd94c155790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009760 tx=0x7fd93c009060 comp rx=0 tx=0).stop 2022-03-15T05:49:37.916 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.908+0000 7fd952207700 1 -- 172.21.15.164:0/3451112619 shutdown_connections 2022-03-15T05:49:37.916 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.908+0000 7fd952207700 1 --2- 172.21.15.164:0/3451112619 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c440 0x7fd94c155790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.916 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.908+0000 7fd952207700 1 --2- 172.21.15.164:0/3451112619 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c069620 0x7fd94c0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.917 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.908+0000 7fd952207700 1 -- 172.21.15.164:0/3451112619 >> 172.21.15.164:0/3451112619 conn(0x7fd94c06e690 msgr2=0x7fd94c06ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:37.917 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.908+0000 7fd952207700 1 -- 172.21.15.164:0/3451112619 shutdown_connections 2022-03-15T05:49:37.917 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.908+0000 7fd952207700 1 -- 172.21.15.164:0/3451112619 wait complete. 2022-03-15T05:49:37.920 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.909+0000 7fd952207700 1 Processor -- start 2022-03-15T05:49:37.920 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.909+0000 7fd952207700 1 -- start start 2022-03-15T05:49:37.921 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd952207700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94c069620 0x7fd94c0c20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.921 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd952207700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c06c440 0x7fd94c0c2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.921 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd952207700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c810 0x7fd94c0c0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:37.921 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd952207700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0bf040 con 0x7fd94c069620 2022-03-15T05:49:37.922 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd952207700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0be7e0 con 0x7fd94c06c810 2022-03-15T05:49:37.922 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd952207700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd94c0c1930 con 0x7fd94c06c440 2022-03-15T05:49:37.922 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94affd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c06c440 0x7fd94c0c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.922 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94bfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c810 0x7fd94c0c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.922 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94affd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c06c440 0x7fd94c0c2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.164:44608/0 (socket says 172.21.15.164:44608) 2022-03-15T05:49:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94bfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c810 0x7fd94c0c0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54508/0 (socket says 172.21.15.164:54508) 2022-03-15T05:49:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94affd700 1 -- 172.21.15.164:0/309289157 learned_addr learned my addr 172.21.15.164:0/309289157 (peer_addr_for_me v2:172.21.15.164:0/0) 2022-03-15T05:49:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94b7fe700 1 --2- 172.21.15.164:0/309289157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94c069620 0x7fd94c0c20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:37.923 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94bfff700 1 -- 172.21.15.164:0/309289157 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c06c440 msgr2=0x7fd94c0c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.924 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94bfff700 1 --2- 172.21.15.164:0/309289157 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c06c440 0x7fd94c0c2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.924 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94bfff700 1 -- 172.21.15.164:0/309289157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94c069620 msgr2=0x7fd94c0c20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:37.924 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94bfff700 1 --2- 172.21.15.164:0/309289157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94c069620 0x7fd94c0c20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:37.924 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94bfff700 1 -- 172.21.15.164:0/309289157 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93c0092a0 con 0x7fd94c06c810 2022-03-15T05:49:37.925 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94b7fe700 1 --2- 172.21.15.164:0/309289157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94c069620 0x7fd94c0c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-15T05:49:37.925 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.910+0000 7fd94bfff700 1 --2- 172.21.15.164:0/309289157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c810 0x7fd94c0c0430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd94400c840 tx=0x7fd944001490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:37.925 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.911+0000 7fd9337fe700 1 -- 172.21.15.164:0/309289157 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944004c40 con 0x7fd94c06c810 2022-03-15T05:49:37.925 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.911+0000 7fd9337fe700 1 -- 172.21.15.164:0/309289157 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd944004da0 con 0x7fd94c06c810 2022-03-15T05:49:37.925 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.911+0000 7fd9337fe700 1 -- 172.21.15.164:0/309289157 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9440073a0 con 0x7fd94c06c810 2022-03-15T05:49:37.926 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.911+0000 7fd952207700 1 -- 172.21.15.164:0/309289157 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd94c14e750 con 0x7fd94c06c810 2022-03-15T05:49:37.926 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.911+0000 7fd952207700 1 -- 172.21.15.164:0/309289157 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd94c0bed60 con 0x7fd94c06c810 2022-03-15T05:49:37.926 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.911+0000 7fd9337fe700 1 -- 172.21.15.164:0/309289157 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fd944010030 con 0x7fd94c06c810 2022-03-15T05:49:37.926 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.911+0000 7fd9337fe700 1 -- 172.21.15.164:0/309289157 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7fd94401e440 con 0x7fd94c06c810 2022-03-15T05:49:37.926 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.913+0000 7fd952207700 1 -- 172.21.15.164:0/309289157 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd94c0c1790 con 0x7fd94c06c810 2022-03-15T05:49:37.927 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:37.915+0000 7fd9337fe700 1 -- 172.21.15.164:0/309289157 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7fd94c0c1790 con 0x7fd94c06c810 2022-03-15T05:49:37.999 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:37.996+0000 7f375a296000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2022-03-15T05:49:38.011 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.008+0000 7fd952207700 1 -- 172.21.15.164:0/309289157 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3ed8d241-1f34-400f-b33e-a8cfb1132fca", "id": 7} v 0) v1 -- 0x7fd94c0c41a0 con 0x7fd94c06c810 2022-03-15T05:49:38.018 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.016+0000 7fd9337fe700 1 -- 172.21.15.164:0/309289157 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3ed8d241-1f34-400f-b33e-a8cfb1132fca", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd94401e600 con 0x7fd94c06c810 2022-03-15T05:49:38.019 INFO:teuthology.orchestra.run.smithi164.stdout:7 2022-03-15T05:49:38.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.017+0000 7fd952207700 1 -- 172.21.15.164:0/309289157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c810 msgr2=0x7fd94c0c0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:38.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.017+0000 7fd952207700 1 --2- 172.21.15.164:0/309289157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c810 0x7fd94c0c0430 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fd94400c840 tx=0x7fd944001490 comp rx=0 tx=0).stop 2022-03-15T05:49:38.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.017+0000 7fd952207700 1 -- 172.21.15.164:0/309289157 shutdown_connections 2022-03-15T05:49:38.020 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.017+0000 7fd952207700 1 --2- 172.21.15.164:0/309289157 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd94c06c810 0x7fd94c0c0430 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:38.021 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.017+0000 7fd952207700 1 --2- 172.21.15.164:0/309289157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd94c069620 0x7fd94c0c20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:38.021 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.017+0000 7fd952207700 1 --2- 172.21.15.164:0/309289157 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fd94c06c440 0x7fd94c0c2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:38.021 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.017+0000 7fd952207700 1 -- 172.21.15.164:0/309289157 >> 172.21.15.164:0/309289157 conn(0x7fd94c06e690 msgr2=0x7fd94c153680 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:38.022 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.018+0000 7fd952207700 1 -- 172.21.15.164:0/309289157 shutdown_connections 2022-03-15T05:49:38.022 INFO:teuthology.orchestra.run.smithi164.stderr:2022-03-15T05:49:38.018+0000 7fd952207700 1 -- 172.21.15.164:0/309289157 wait complete. 2022-03-15T05:49:38.032 INFO:tasks.ceph.osd.0:Restarting daemon 2022-03-15T05:49:38.033 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2022-03-15T05:49:38.037 INFO:tasks.ceph.osd.0:Started 2022-03-15T05:49:38.038 INFO:tasks.ceph.osd.1:Restarting daemon 2022-03-15T05:49:38.038 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2022-03-15T05:49:38.041 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:38.038+0000 7f4652c96000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-03-15T05:49:38.042 INFO:tasks.ceph.osd.1:Started 2022-03-15T05:49:38.043 INFO:tasks.ceph.osd.2:Restarting daemon 2022-03-15T05:49:38.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2022-03-15T05:49:38.049 INFO:tasks.ceph.osd.2:Started 2022-03-15T05:49:38.049 INFO:tasks.ceph.osd.3:Restarting daemon 2022-03-15T05:49:38.050 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2022-03-15T05:49:38.055 INFO:tasks.ceph.osd.3:Started 2022-03-15T05:49:38.055 INFO:tasks.ceph.osd.4:Restarting daemon 2022-03-15T05:49:38.056 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2022-03-15T05:49:38.058 INFO:tasks.ceph.osd.4:Started 2022-03-15T05:49:38.058 INFO:tasks.ceph.osd.5:Restarting daemon 2022-03-15T05:49:38.059 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2022-03-15T05:49:38.061 INFO:tasks.ceph.osd.5:Started 2022-03-15T05:49:38.061 INFO:tasks.ceph.osd.6:Restarting daemon 2022-03-15T05:49:38.062 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2022-03-15T05:49:38.064 INFO:tasks.ceph.osd.6:Started 2022-03-15T05:49:38.064 INFO:tasks.ceph.osd.7:Restarting daemon 2022-03-15T05:49:38.065 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2022-03-15T05:49:38.067 INFO:tasks.ceph.osd.7:Started 2022-03-15T05:49:38.068 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-15T05:49:38.174 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:38.171+0000 7f4652c96000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-03-15T05:49:38.197 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:38.195+0000 7f375a296000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2022-03-15T05:49:38.264 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:38.261+0000 7f4652c96000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-03-15T05:49:38.324 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:38.321+0000 7f375a296000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2022-03-15T05:49:38.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.358+0000 7ffa24725700 1 Processor -- start 2022-03-15T05:49:38.362 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.359+0000 7ffa24725700 1 -- start start 2022-03-15T05:49:38.363 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.360+0000 7ffa24725700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ffa1c0c34e0 0x7ffa1c155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:38.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.360+0000 7ffa24725700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c0c27b0 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.360+0000 7ffa24725700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa1c0c4f90 con 0x7ffa1c0cb1f0 2022-03-15T05:49:38.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.360+0000 7ffa24725700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa1c0c5270 con 0x7ffa1c0c34e0 2022-03-15T05:49:38.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.360+0000 7ffa224c1700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ffa1c0cb1f0 0x7ffa1c1566c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33612/0 (socket says 172.21.15.151:33612) 2022-03-15T05:49:38.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.360+0000 7ffa224c1700 1 -- 172.21.15.151:0/1630798343 learned_addr learned my addr 172.21.15.151:0/1630798343 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:38.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.360+0000 7ffa22cc2700 1 --2- 172.21.15.151:0/1630798343 >> v2:172.21.15.164:3300/0 conn(0x7ffa1c0c34e0 0x7ffa1c155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:38.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.360+0000 7ffa21cc0700 1 --1- 172.21.15.151:0/1630798343 >> v1:172.21.15.151:6789/0 conn(0x7ffa1c0cb5c0 0x7ffa1c0c58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53138/0 (socket says 172.21.15.151:53138) 2022-03-15T05:49:38.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.361+0000 7ffa214bf700 1 -- 172.21.15.151:0/1630798343 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818543291 0 0) 0x7ffa1c0c4f90 con 0x7ffa1c0cb1f0 2022-03-15T05:49:38.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.361+0000 7ffa214bf700 1 -- 172.21.15.151:0/1630798343 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa040033f0 con 0x7ffa1c0cb1f0 2022-03-15T05:49:38.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.361+0000 7ffa22cc2700 1 -- 172.21.15.151:0/1630798343 >> v1:172.21.15.164:6789/0 conn(0x7ffa1c0cb1f0 legacy=0x7ffa1c1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:38.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.361+0000 7ffa22cc2700 1 -- 172.21.15.151:0/1630798343 >> v1:172.21.15.151:6789/0 conn(0x7ffa1c0cb5c0 legacy=0x7ffa1c0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:38.367 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.361+0000 7ffa214bf700 1 -- 172.21.15.151:0/1630798343 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337551421 0 0) 0x7ffa1c0c27b0 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.367 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.361+0000 7ffa22cc2700 1 -- 172.21.15.151:0/1630798343 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c0c2a00 con 0x7ffa1c0c34e0 2022-03-15T05:49:38.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.361+0000 7ffa22cc2700 1 --2- 172.21.15.151:0/1630798343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa1c0c34e0 0x7ffa1c155cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009e60 tx=0x7ffa14009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6726a5a697f55ed server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:38.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.361+0000 7ffa214bf700 1 -- 172.21.15.151:0/1630798343 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1400e070 con 0x7ffa1c0c34e0 2022-03-15T05:49:38.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.361+0000 7ffa214bf700 1 -- 172.21.15.151:0/1630798343 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1400bb60 con 0x7ffa1c0c34e0 2022-03-15T05:49:38.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.362+0000 7ffa214bf700 1 -- 172.21.15.151:0/1630798343 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14012430 con 0x7ffa1c0c34e0 2022-03-15T05:49:38.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.362+0000 7ffa24725700 1 -- 172.21.15.151:0/1630798343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa1c0c34e0 msgr2=0x7ffa1c155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:38.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.362+0000 7ffa24725700 1 --2- 172.21.15.151:0/1630798343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa1c0c34e0 0x7ffa1c155cf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ffa14009e60 tx=0x7ffa14009780 comp rx=0 tx=0).stop 2022-03-15T05:49:38.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.362+0000 7ffa24725700 1 -- 172.21.15.151:0/1630798343 shutdown_connections 2022-03-15T05:49:38.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.362+0000 7ffa24725700 1 --2- 172.21.15.151:0/1630798343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa1c0c34e0 0x7ffa1c155cf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:38.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.362+0000 7ffa24725700 1 -- 172.21.15.151:0/1630798343 >> 172.21.15.151:0/1630798343 conn(0x7ffa1c068e90 msgr2=0x7ffa1c069290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:38.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.362+0000 7ffa24725700 1 -- 172.21.15.151:0/1630798343 shutdown_connections 2022-03-15T05:49:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.362+0000 7ffa24725700 1 -- 172.21.15.151:0/1630798343 wait complete. 2022-03-15T05:49:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.364+0000 7ffa24725700 1 Processor -- start 2022-03-15T05:49:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.364+0000 7ffa24725700 1 -- start start 2022-03-15T05:49:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa24725700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa1c0c34e0 0x7ffa1c164b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:38.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa24725700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa1c0cb1f0 0x7ffa1c14ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:38.375 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa24725700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa1c0cb5c0 0x7ffa1c14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:38.375 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa24725700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c165fd0 con 0x7ffa1c0c34e0 2022-03-15T05:49:38.375 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa24725700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c156370 con 0x7ffa1c0cb1f0 2022-03-15T05:49:38.375 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa24725700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa1c14e830 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa224c1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa1c0c34e0 0x7ffa1c164b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa22cc2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa1c0cb5c0 0x7ffa1c14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa21cc0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa1c0cb1f0 0x7ffa1c14ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:38.376 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa22cc2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa1c0cb5c0 0x7ffa1c14d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60010/0 (socket says 172.21.15.151:60010) 2022-03-15T05:49:38.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.365+0000 7ffa22cc2700 1 -- 172.21.15.151:0/1903595364 learned_addr learned my addr 172.21.15.151:0/1903595364 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:38.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.366+0000 7ffa22cc2700 1 -- 172.21.15.151:0/1903595364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa1c0cb1f0 msgr2=0x7ffa1c14ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:38.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.366+0000 7ffa22cc2700 1 --2- 172.21.15.151:0/1903595364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa1c0cb1f0 0x7ffa1c14ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:38.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.366+0000 7ffa22cc2700 1 -- 172.21.15.151:0/1903595364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa1c0c34e0 msgr2=0x7ffa1c164b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:38.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.366+0000 7ffa22cc2700 1 --2- 172.21.15.151:0/1903595364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa1c0c34e0 0x7ffa1c164b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.366+0000 7ffa22cc2700 1 -- 172.21.15.151:0/1903595364 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa14009a20 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.366+0000 7ffa21cc0700 1 --2- 172.21.15.151:0/1903595364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa1c0cb1f0 0x7ffa1c14ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.366+0000 7ffa22cc2700 1 --2- 172.21.15.151:0/1903595364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa1c0cb5c0 0x7ffa1c14d560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400b6c0 tx=0x7ffa14019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:38.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.366+0000 7ffa0a7fc700 1 -- 172.21.15.151:0/1903595364 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14012d00 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.367+0000 7ffa0a7fc700 1 -- 172.21.15.151:0/1903595364 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa14012e60 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.367+0000 7ffa24725700 1 -- 172.21.15.151:0/1903595364 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa1c14eb00 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.367+0000 7ffa0a7fc700 1 -- 172.21.15.151:0/1903595364 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa14026640 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.367+0000 7ffa24725700 1 -- 172.21.15.151:0/1903595364 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa1c14f0c0 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.367+0000 7ffa0a7fc700 1 -- 172.21.15.151:0/1903595364 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7ffa14026a30 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.367+0000 7ffa0a7fc700 1 -- 172.21.15.151:0/1903595364 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7ffa14026cc0 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.368+0000 7ffa24725700 1 -- 172.21.15.151:0/1903595364 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa1c0700c0 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.370+0000 7ffa0a7fc700 1 -- 172.21.15.151:0/1903595364 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7ffa1401b3f0 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.444+0000 7ffa24725700 1 -- 172.21.15.151:0/1903595364 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffa1c088260 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.448 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.445+0000 7ffa0a7fc700 1 -- 172.21.15.151:0/1903595364 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6992 (secure 0 0 0) 0x7ffa1401b590 con 0x7ffa1c0cb5c0 2022-03-15T05:49:38.448 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:49:38.449 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":10,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:49:38.010948+0000","last_up_change":"0.000000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:49:38.450 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.446+0000 7ffa24725700 1 -- 172.21.15.151:0/1903595364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa1c0cb5c0 msgr2=0x7ffa1c14d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:38.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.446+0000 7ffa24725700 1 --2- 172.21.15.151:0/1903595364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa1c0cb5c0 0x7ffa1c14d560 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400b6c0 tx=0x7ffa14019000 comp rx=0 tx=0).stop 2022-03-15T05:49:38.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.446+0000 7ffa24725700 1 -- 172.21.15.151:0/1903595364 shutdown_connections 2022-03-15T05:49:38.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.446+0000 7ffa24725700 1 --2- 172.21.15.151:0/1903595364 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa1c0cb5c0 0x7ffa1c14d560 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:38.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.446+0000 7ffa24725700 1 --2- 172.21.15.151:0/1903595364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa1c0c34e0 0x7ffa1c164b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:38.452 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.446+0000 7ffa24725700 1 --2- 172.21.15.151:0/1903595364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa1c0cb1f0 0x7ffa1c14ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:38.452 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.446+0000 7ffa24725700 1 -- 172.21.15.151:0/1903595364 >> 172.21.15.151:0/1903595364 conn(0x7ffa1c068e90 msgr2=0x7ffa1c155930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:38.452 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.446+0000 7ffa24725700 1 -- 172.21.15.151:0/1903595364 shutdown_connections 2022-03-15T05:49:38.453 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:38.446+0000 7ffa24725700 1 -- 172.21.15.151:0/1903595364 wait complete. 2022-03-15T05:49:38.473 INFO:tasks.ceph.ceph_manager.ceph:[] 2022-03-15T05:49:38.473 INFO:tasks.ceph:Waiting for OSDs to come up 2022-03-15T05:49:38.537 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:38.534+0000 7f375a296000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2022-03-15T05:49:38.665 INFO:tasks.ceph.osd.5.smithi164.stderr:2022-03-15T05:49:38.662+0000 7f9a0191f3c0 -1 Falling back to public interface 2022-03-15T05:49:38.681 INFO:tasks.ceph.osd.7.smithi164.stderr:2022-03-15T05:49:38.678+0000 7f7a9d2de3c0 -1 Falling back to public interface 2022-03-15T05:49:38.682 INFO:tasks.ceph.osd.6.smithi164.stderr:2022-03-15T05:49:38.679+0000 7f20a0da33c0 -1 Falling back to public interface 2022-03-15T05:49:38.687 INFO:tasks.ceph.osd.4.smithi164.stderr:2022-03-15T05:49:38.684+0000 7f618508d3c0 -1 Falling back to public interface 2022-03-15T05:49:38.776 INFO:tasks.ceph.osd.0.smithi151.stderr:2022-03-15T05:49:38.773+0000 7f6b54dba3c0 -1 Falling back to public interface 2022-03-15T05:49:38.796 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:38.793+0000 7f375a296000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2022-03-15T05:49:38.798 INFO:tasks.ceph.osd.3.smithi151.stderr:2022-03-15T05:49:38.795+0000 7f70ad5c33c0 -1 Falling back to public interface 2022-03-15T05:49:38.809 INFO:tasks.ceph.osd.2.smithi151.stderr:2022-03-15T05:49:38.806+0000 7feab1d163c0 -1 Falling back to public interface 2022-03-15T05:49:38.813 INFO:tasks.ceph.osd.1.smithi151.stderr:2022-03-15T05:49:38.810+0000 7f7bd9c233c0 -1 Falling back to public interface 2022-03-15T05:49:38.953 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:38.950+0000 7f4652c96000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-03-15T05:49:38.966 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:38.963+0000 7f375a296000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2022-03-15T05:49:39.095 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:39.092+0000 7f375a296000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2022-03-15T05:49:39.202 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:39.200+0000 7f4652c96000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-03-15T05:49:39.279 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-03-15T05:49:39.467 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.463+0000 7fc060cbd700 1 Processor -- start 2022-03-15T05:49:39.467 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.464+0000 7fc060cbd700 1 -- start start 2022-03-15T05:49:39.469 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc060cbd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc05c068c90 0x7fc05c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:39.470 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc060cbd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0bed90 0x7fc05c067830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:39.470 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc060cbd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc05c0cba70 0x7fc05c067d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:39.470 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc060cbd700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c0bfb20 con 0x7fc05c068c90 2022-03-15T05:49:39.470 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc060cbd700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c1546b0 con 0x7fc05c0cba70 2022-03-15T05:49:39.471 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc060cbd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c154c30 con 0x7fc05c0bed90 2022-03-15T05:49:39.471 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc05b7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc05c068c90 0x7fc05c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:39.471 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc05bfff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc05c0cba70 0x7fc05c067d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:39.471 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc05affd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0bed90 0x7fc05c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:39.471 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc05bfff700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc05c0cba70 0x7fc05c067d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57128/0 (socket says 172.21.15.151:57128) 2022-03-15T05:49:39.472 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc05b7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc05c068c90 0x7fc05c1550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59894/0 (socket says 172.21.15.151:59894) 2022-03-15T05:49:39.472 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.465+0000 7fc05bfff700 1 -- 172.21.15.151:0/1822669191 learned_addr learned my addr 172.21.15.151:0/1822669191 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:39.472 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.466+0000 7fc05bfff700 1 -- 172.21.15.151:0/1822669191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0bed90 msgr2=0x7fc05c067830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:39.472 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.466+0000 7fc05bfff700 1 --2- 172.21.15.151:0/1822669191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0bed90 0x7fc05c067830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:39.473 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.466+0000 7fc05bfff700 1 -- 172.21.15.151:0/1822669191 >> v2:172.21.15.151:3300/0 conn(0x7fc05c068c90 msgr2=0x7fc05c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:39.473 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.466+0000 7fc05bfff700 1 --2- 172.21.15.151:0/1822669191 >> v2:172.21.15.151:3300/0 conn(0x7fc05c068c90 0x7fc05c1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:39.473 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.466+0000 7fc05bfff700 1 -- 172.21.15.151:0/1822669191 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c155600 con 0x7fc05c0cba70 2022-03-15T05:49:39.473 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.466+0000 7fc05affd700 1 --2- 172.21.15.151:0/1822669191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0bed90 0x7fc05c067830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:39.474 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.466+0000 7fc05bfff700 1 --2- 172.21.15.151:0/1822669191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc05c0cba70 0x7fc05c067d70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0b0f80 tx=0x7fc054009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53450f7568e0f47a server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:39.474 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.466+0000 7fc05a7fc700 1 -- 172.21.15.151:0/1822669191 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400e070 con 0x7fc05c0cba70 2022-03-15T05:49:39.474 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.466+0000 7fc05a7fc700 1 -- 172.21.15.151:0/1822669191 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05400b970 con 0x7fc05c0cba70 2022-03-15T05:49:39.474 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.466+0000 7fc05a7fc700 1 -- 172.21.15.151:0/1822669191 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0540092e0 con 0x7fc05c0cba70 2022-03-15T05:49:39.474 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.467+0000 7fc060cbd700 1 -- 172.21.15.151:0/1822669191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc05c0cba70 msgr2=0x7fc05c067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:39.475 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.467+0000 7fc060cbd700 1 --2- 172.21.15.151:0/1822669191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc05c0cba70 0x7fc05c067d70 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc05c0b0f80 tx=0x7fc054009840 comp rx=0 tx=0).stop 2022-03-15T05:49:39.478 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.467+0000 7fc060cbd700 1 -- 172.21.15.151:0/1822669191 shutdown_connections 2022-03-15T05:49:39.479 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.467+0000 7fc060cbd700 1 --2- 172.21.15.151:0/1822669191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc05c0cba70 0x7fc05c067d70 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:39.479 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.467+0000 7fc060cbd700 1 --2- 172.21.15.151:0/1822669191 >> v2:172.21.15.151:3300/0 conn(0x7fc05c068c90 0x7fc05c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:39.479 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.467+0000 7fc060cbd700 1 --2- 172.21.15.151:0/1822669191 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0bed90 0x7fc05c067830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:39.479 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.467+0000 7fc060cbd700 1 -- 172.21.15.151:0/1822669191 >> 172.21.15.151:0/1822669191 conn(0x7fc05c06eb80 msgr2=0x7fc05c0cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:39.480 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.467+0000 7fc060cbd700 1 -- 172.21.15.151:0/1822669191 shutdown_connections 2022-03-15T05:49:39.480 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.467+0000 7fc060cbd700 1 -- 172.21.15.151:0/1822669191 wait complete. 2022-03-15T05:49:39.480 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.469+0000 7fc060cbd700 1 Processor -- start 2022-03-15T05:49:39.480 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.469+0000 7fc060cbd700 1 -- start start 2022-03-15T05:49:39.481 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc060cbd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc05c068c90 0x7fc05c155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:39.481 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc060cbd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc05c0bed90 0x7fc05c1684a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:39.481 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc060cbd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0cba70 0x7fc05c14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:39.481 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc060cbd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c156e00 con 0x7fc05c068c90 2022-03-15T05:49:39.482 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc060cbd700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0c3360 con 0x7fc05c0bed90 2022-03-15T05:49:39.482 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc060cbd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c168f00 con 0x7fc05c0cba70 2022-03-15T05:49:39.482 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc05bfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0cba70 0x7fc05c14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:39.482 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc05bfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0cba70 0x7fc05c14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60014/0 (socket says 172.21.15.151:60014) 2022-03-15T05:49:39.483 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc05bfff700 1 -- 172.21.15.151:0/19020298 learned_addr learned my addr 172.21.15.151:0/19020298 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:39.483 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc05b7fe700 1 --2- 172.21.15.151:0/19020298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc05c068c90 0x7fc05c155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:39.483 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc05affd700 1 --2- 172.21.15.151:0/19020298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc05c0bed90 0x7fc05c1684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:39.483 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc05bfff700 1 -- 172.21.15.151:0/19020298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc05c0bed90 msgr2=0x7fc05c1684a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:39.483 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc05bfff700 1 --2- 172.21.15.151:0/19020298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc05c0bed90 0x7fc05c1684a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:39.484 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc05bfff700 1 -- 172.21.15.151:0/19020298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc05c068c90 msgr2=0x7fc05c155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:39.484 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc05bfff700 1 --2- 172.21.15.151:0/19020298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc05c068c90 0x7fc05c155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:39.484 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.470+0000 7fc05bfff700 1 -- 172.21.15.151:0/19020298 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0500092a0 con 0x7fc05c0cba70 2022-03-15T05:49:39.484 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.471+0000 7fc05bfff700 1 --2- 172.21.15.151:0/19020298 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0cba70 0x7fc05c14c1c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc05c1547f0 tx=0x7fc054018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:39.485 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.471+0000 7fc0437fe700 1 -- 172.21.15.151:0/19020298 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0540094e0 con 0x7fc05c0cba70 2022-03-15T05:49:39.485 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.471+0000 7fc0437fe700 1 -- 172.21.15.151:0/19020298 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054004040 con 0x7fc05c0cba70 2022-03-15T05:49:39.485 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.471+0000 7fc0437fe700 1 -- 172.21.15.151:0/19020298 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0540043e0 con 0x7fc05c0cba70 2022-03-15T05:49:39.485 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.471+0000 7fc060cbd700 1 -- 172.21.15.151:0/19020298 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc054009ae0 con 0x7fc05c0cba70 2022-03-15T05:49:39.486 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.471+0000 7fc060cbd700 1 -- 172.21.15.151:0/19020298 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c1500f0 con 0x7fc05c0cba70 2022-03-15T05:49:39.486 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.471+0000 7fc0437fe700 1 -- 172.21.15.151:0/19020298 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 1) v1 ==== 517+0+0 (secure 0 0 0) 0x7fc05401c410 con 0x7fc05c0cba70 2022-03-15T05:49:39.486 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.472+0000 7fc0437fe700 1 -- 172.21.15.151:0/19020298 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fc0540047d0 con 0x7fc05c0cba70 2022-03-15T05:49:39.486 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.472+0000 7fc060cbd700 1 -- 172.21.15.151:0/19020298 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05c0c1c50 con 0x7fc05c0cba70 2022-03-15T05:49:39.486 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.475+0000 7fc0437fe700 1 -- 172.21.15.151:0/19020298 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+70738 (secure 0 0 0) 0x7fc054029020 con 0x7fc05c0cba70 2022-03-15T05:49:39.550 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.547+0000 7fc060cbd700 1 -- 172.21.15.151:0/19020298 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc05c0c3150 con 0x7fc05c0cba70 2022-03-15T05:49:39.550 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.548+0000 7fc0437fe700 1 -- 172.21.15.151:0/19020298 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6992 (secure 0 0 0) 0x7fc05401c6a0 con 0x7fc05c0cba70 2022-03-15T05:49:39.551 INFO:teuthology.misc.health.smithi151.stdout: 2022-03-15T05:49:39.551 INFO:teuthology.misc.health.smithi151.stdout:{"epoch":10,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:49:38.010948+0000","last_up_change":"0.000000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:49:39.553 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.549+0000 7fc060cbd700 1 -- 172.21.15.151:0/19020298 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0cba70 msgr2=0x7fc05c14c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:39.553 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.549+0000 7fc060cbd700 1 --2- 172.21.15.151:0/19020298 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0cba70 0x7fc05c14c1c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc05c1547f0 tx=0x7fc054018000 comp rx=0 tx=0).stop 2022-03-15T05:49:39.553 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.549+0000 7fc060cbd700 1 -- 172.21.15.151:0/19020298 shutdown_connections 2022-03-15T05:49:39.553 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.549+0000 7fc060cbd700 1 --2- 172.21.15.151:0/19020298 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc05c0cba70 0x7fc05c14c1c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:39.554 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.549+0000 7fc060cbd700 1 --2- 172.21.15.151:0/19020298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc05c068c90 0x7fc05c155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:39.554 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.549+0000 7fc060cbd700 1 --2- 172.21.15.151:0/19020298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc05c0bed90 0x7fc05c1684a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:39.554 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.549+0000 7fc060cbd700 1 -- 172.21.15.151:0/19020298 >> 172.21.15.151:0/19020298 conn(0x7fc05c06eb80 msgr2=0x7fc05c14e430 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:39.554 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.549+0000 7fc060cbd700 1 -- 172.21.15.151:0/19020298 shutdown_connections 2022-03-15T05:49:39.555 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:39.549+0000 7fc060cbd700 1 -- 172.21.15.151:0/19020298 wait complete. 2022-03-15T05:49:39.571 DEBUG:teuthology.misc:0 of 8 OSDs are up 2022-03-15T05:49:39.772 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:39.769+0000 7f4652c96000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-03-15T05:49:39.903 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:39.900+0000 7f4652c96000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-03-15T05:49:40.054 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:40.051+0000 7f375a296000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2022-03-15T05:49:40.223 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:40.221+0000 7f4652c96000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-03-15T05:49:40.297 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:40.294+0000 7f4652c96000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-03-15T05:49:40.369 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:40.366+0000 7f4652c96000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-03-15T05:49:40.375 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:40.373+0000 7f375a296000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2022-03-15T05:49:40.452 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:40.449+0000 7f4652c96000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-03-15T05:49:40.526 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:40.523+0000 7f4652c96000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-03-15T05:49:40.624 INFO:tasks.ceph.mgr.x.smithi164.stderr:2022-03-15T05:49:40.621+0000 7f4652c96000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-03-15T05:49:41.223 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:41.220+0000 7f375a296000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2022-03-15T05:49:41.443 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:41.440+0000 7f375a296000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2022-03-15T05:49:41.946 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:41.943+0000 7f375a296000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2022-03-15T05:49:42.081 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:42.078+0000 7f375a296000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2022-03-15T05:49:42.212 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:42.209+0000 7f375a296000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2022-03-15T05:49:42.214 INFO:tasks.ceph.osd.5.smithi164.stderr:2022-03-15T05:49:42.210+0000 7f9a0191f3c0 -1 osd.5 0 log_to_monitors true 2022-03-15T05:49:42.229 INFO:tasks.ceph.osd.7.smithi164.stderr:2022-03-15T05:49:42.226+0000 7f7a9d2de3c0 -1 osd.7 0 log_to_monitors true 2022-03-15T05:49:42.239 INFO:tasks.ceph.osd.6.smithi164.stderr:2022-03-15T05:49:42.237+0000 7f20a0da33c0 -1 osd.6 0 log_to_monitors true 2022-03-15T05:49:42.257 INFO:tasks.ceph.osd.4.smithi164.stderr:2022-03-15T05:49:42.254+0000 7f618508d3c0 -1 osd.4 0 log_to_monitors true 2022-03-15T05:49:42.360 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:42.357+0000 7f375a296000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2022-03-15T05:49:42.423 INFO:tasks.ceph.osd.0.smithi151.stderr:2022-03-15T05:49:42.420+0000 7f6b54dba3c0 -1 osd.0 0 log_to_monitors true 2022-03-15T05:49:42.502 INFO:tasks.ceph.osd.1.smithi151.stderr:2022-03-15T05:49:42.499+0000 7f7bd9c233c0 -1 osd.1 0 log_to_monitors true 2022-03-15T05:49:42.516 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:42.513+0000 7f375a296000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2022-03-15T05:49:42.692 INFO:tasks.ceph.mgr.y.smithi151.stderr:2022-03-15T05:49:42.689+0000 7f375a296000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2022-03-15T05:49:42.710 INFO:tasks.ceph.osd.3.smithi151.stderr:2022-03-15T05:49:42.707+0000 7f70ad5c33c0 -1 osd.3 0 log_to_monitors true 2022-03-15T05:49:42.715 INFO:tasks.ceph.osd.2.smithi151.stderr:2022-03-15T05:49:42.712+0000 7feab1d163c0 -1 osd.2 0 log_to_monitors true 2022-03-15T05:49:45.309 INFO:tasks.ceph.osd.0.smithi151.stderr:2022-03-15T05:49:45.306+0000 7f6b4b9d5700 -1 osd.0 0 waiting for initial osdmap 2022-03-15T05:49:45.320 INFO:tasks.ceph.osd.0.smithi151.stderr:2022-03-15T05:49:45.317+0000 7f6b44367700 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-15T05:49:45.718 INFO:tasks.ceph.osd.7.smithi164.stderr:2022-03-15T05:49:45.714+0000 7f7a93ef9700 -1 osd.7 0 waiting for initial osdmap 2022-03-15T05:49:45.722 INFO:tasks.ceph.osd.7.smithi164.stderr:2022-03-15T05:49:45.719+0000 7f7a8c88b700 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-15T05:49:45.746 INFO:tasks.ceph.osd.5.smithi164.stderr:2022-03-15T05:49:45.744+0000 7f99f853a700 -1 osd.5 0 waiting for initial osdmap 2022-03-15T05:49:45.750 INFO:tasks.ceph.osd.5.smithi164.stderr:2022-03-15T05:49:45.747+0000 7f99f0ecc700 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-15T05:49:45.758 INFO:tasks.ceph.osd.4.smithi164.stderr:2022-03-15T05:49:45.755+0000 7f617bca8700 -1 osd.4 0 waiting for initial osdmap 2022-03-15T05:49:45.761 INFO:tasks.ceph.osd.4.smithi164.stderr:2022-03-15T05:49:45.759+0000 7f617463a700 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-15T05:49:45.762 INFO:tasks.ceph.osd.6.smithi164.stderr:2022-03-15T05:49:45.759+0000 7f20979be700 -1 osd.6 0 waiting for initial osdmap 2022-03-15T05:49:45.766 INFO:tasks.ceph.osd.6.smithi164.stderr:2022-03-15T05:49:45.763+0000 7f2090350700 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-15T05:49:46.052 INFO:tasks.ceph.osd.1.smithi151.stderr:2022-03-15T05:49:46.049+0000 7f7bd083e700 -1 osd.1 0 waiting for initial osdmap 2022-03-15T05:49:46.060 INFO:tasks.ceph.osd.1.smithi151.stderr:2022-03-15T05:49:46.057+0000 7f7bc91d0700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-15T05:49:46.379 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-03-15T05:49:46.641 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.637+0000 7f4e1d080700 1 Processor -- start 2022-03-15T05:49:46.641 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.638+0000 7f4e1d080700 1 -- start start 2022-03-15T05:49:46.642 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.639+0000 7f4e1d080700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e18068c90 0x7f4e181550c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:46.642 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.639+0000 7f4e1d080700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e18067f40 0x7f4e1815f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:46.643 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.639+0000 7f4e1d080700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e18154c30 con 0x7f4e180bed90 2022-03-15T05:49:46.643 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.639+0000 7f4e1d080700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e180bfb20 con 0x7f4e18068c90 2022-03-15T05:49:46.643 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.639+0000 7f4e1d080700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e181546b0 con 0x7f4e18067f40 2022-03-15T05:49:46.643 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.639+0000 7f4e17fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e18068c90 0x7f4e181550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:46.644 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.639+0000 7f4e17fff700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4e18068c90 0x7f4e181550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59906/0 (socket says 172.21.15.151:59906) 2022-03-15T05:49:46.644 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.639+0000 7f4e17fff700 1 -- 172.21.15.151:0/234955539 learned_addr learned my addr 172.21.15.151:0/234955539 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:46.644 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.639+0000 7f4e177fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f4e180bed90 0x7f4e18067830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53140/0 (socket says 172.21.15.151:53140) 2022-03-15T05:49:46.646 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.640+0000 7f4e1c87f700 1 --2- 172.21.15.151:0/234955539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e18067f40 0x7f4e1815f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:46.646 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.640+0000 7f4e17fff700 1 -- 172.21.15.151:0/234955539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e18067f40 msgr2=0x7f4e1815f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:46.646 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.640+0000 7f4e17fff700 1 --2- 172.21.15.151:0/234955539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e18067f40 0x7f4e1815f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.647 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.640+0000 7f4e17fff700 1 -- 172.21.15.151:0/234955539 >> v1:172.21.15.151:6789/0 conn(0x7f4e180bed90 legacy=0x7f4e18067830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:46.647 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.640+0000 7f4e17fff700 1 -- 172.21.15.151:0/234955539 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e18155600 con 0x7f4e18068c90 2022-03-15T05:49:46.647 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.640+0000 7f4e17fff700 1 --2- 172.21.15.151:0/234955539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 0x7f4e181550c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e08006fd0 tx=0x7f4e080090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9ba6ce095bae55 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:46.647 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.641+0000 7f4e16ffd700 1 -- 172.21.15.151:0/234955539 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08004030 con 0x7f4e18068c90 2022-03-15T05:49:46.648 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.641+0000 7f4e16ffd700 1 -- 172.21.15.151:0/234955539 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e08004190 con 0x7f4e18068c90 2022-03-15T05:49:46.648 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.641+0000 7f4e16ffd700 1 -- 172.21.15.151:0/234955539 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e08011630 con 0x7f4e18068c90 2022-03-15T05:49:46.648 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.641+0000 7f4e1d080700 1 -- 172.21.15.151:0/234955539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 msgr2=0x7f4e181550c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:46.649 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.641+0000 7f4e1d080700 1 --2- 172.21.15.151:0/234955539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 0x7f4e181550c0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4e08006fd0 tx=0x7f4e080090f0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.649 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.642+0000 7f4e1d080700 1 -- 172.21.15.151:0/234955539 shutdown_connections 2022-03-15T05:49:46.649 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.642+0000 7f4e1d080700 1 --2- 172.21.15.151:0/234955539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e18067f40 0x7f4e1815f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.650 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.642+0000 7f4e1d080700 1 --2- 172.21.15.151:0/234955539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 0x7f4e181550c0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.650 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.642+0000 7f4e1d080700 1 -- 172.21.15.151:0/234955539 >> 172.21.15.151:0/234955539 conn(0x7f4e1806eb80 msgr2=0x7f4e180cae50 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:46.650 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.642+0000 7f4e1d080700 1 -- 172.21.15.151:0/234955539 shutdown_connections 2022-03-15T05:49:46.650 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.642+0000 7f4e1d080700 1 -- 172.21.15.151:0/234955539 wait complete. 2022-03-15T05:49:46.652 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.644+0000 7f4e1d080700 1 Processor -- start 2022-03-15T05:49:46.653 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.645+0000 7f4e1d080700 1 -- start start 2022-03-15T05:49:46.653 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.646+0000 7f4e1d080700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e18067f40 0x7f4e180c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:46.653 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.646+0000 7f4e1d080700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 0x7f4e180a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:46.653 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.646+0000 7f4e1d080700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e180bed90 0x7f4e18166150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:46.654 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.646+0000 7f4e1d080700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e180a7ad0 con 0x7f4e18068c90 2022-03-15T05:49:46.654 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.646+0000 7f4e1d080700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e18168f00 con 0x7f4e180bed90 2022-03-15T05:49:46.654 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.646+0000 7f4e1d080700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e180c3eb0 con 0x7f4e18067f40 2022-03-15T05:49:46.654 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.646+0000 7f4e177fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 0x7f4e180a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:46.655 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.646+0000 7f4e177fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 0x7f4e180a67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59908/0 (socket says 172.21.15.151:59908) 2022-03-15T05:49:46.655 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.646+0000 7f4e177fe700 1 -- 172.21.15.151:0/1985850098 learned_addr learned my addr 172.21.15.151:0/1985850098 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:46.655 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.647+0000 7f4e17fff700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e18067f40 0x7f4e180c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:46.655 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.647+0000 7f4e1c87f700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e180bed90 0x7f4e18166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:46.655 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.647+0000 7f4e177fe700 1 -- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e18067f40 msgr2=0x7f4e180c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:46.656 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.647+0000 7f4e177fe700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e18067f40 0x7f4e180c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.656 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.647+0000 7f4e177fe700 1 -- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e180bed90 msgr2=0x7f4e18166150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:46.656 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.647+0000 7f4e177fe700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e180bed90 0x7f4e18166150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.656 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.647+0000 7f4e177fe700 1 -- 172.21.15.151:0/1985850098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e08009370 con 0x7f4e18068c90 2022-03-15T05:49:46.657 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.648+0000 7f4e177fe700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 0x7f4e180a67b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00c440 tx=0x7f4e0c007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:46.657 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.648+0000 7f4dfffff700 1 -- 172.21.15.151:0/1985850098 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c00ce60 con 0x7f4e18068c90 2022-03-15T05:49:46.657 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.648+0000 7f4dfffff700 1 -- 172.21.15.151:0/1985850098 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0c0072e0 con 0x7f4e18068c90 2022-03-15T05:49:46.657 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.648+0000 7f4dfffff700 1 -- 172.21.15.151:0/1985850098 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0c0046b0 con 0x7f4e18068c90 2022-03-15T05:49:46.658 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.648+0000 7f4e1d080700 1 -- 172.21.15.151:0/1985850098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e180c4190 con 0x7f4e18068c90 2022-03-15T05:49:46.659 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.649+0000 7f4e1d080700 1 -- 172.21.15.151:0/1985850098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e180cb7d0 con 0x7f4e18068c90 2022-03-15T05:49:46.659 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.650+0000 7f4e1d080700 1 -- 172.21.15.151:0/1985850098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e180c3cf0 con 0x7f4e18068c90 2022-03-15T05:49:46.659 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.651+0000 7f4dfffff700 1 -- 172.21.15.151:0/1985850098 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 4) v1 ==== 81290+0+0 (secure 0 0 0) 0x7f4e0c010070 con 0x7f4e18068c90 2022-03-15T05:49:46.660 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.653+0000 7f4dfffff700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4df8063440 0x7f4df80658f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:46.660 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.653+0000 7f4dfffff700 1 -- 172.21.15.151:0/1985850098 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3907+0+0 (secure 0 0 0) 0x7f4e0c07e2d0 con 0x7f4e18068c90 2022-03-15T05:49:46.660 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.653+0000 7f4e17fff700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4df8063440 0x7f4df80658f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:46.660 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.654+0000 7f4e17fff700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4df8063440 0x7f4df80658f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4e08006fd0 tx=0x7f4e08016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:46.663 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.661+0000 7f4dfffff700 1 -- 172.21.15.151:0/1985850098 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f4e0c048ac0 con 0x7f4e18068c90 2022-03-15T05:49:46.669 INFO:tasks.ceph.osd.3.smithi151.stderr:2022-03-15T05:49:46.667+0000 7f70a41de700 -1 osd.3 0 waiting for initial osdmap 2022-03-15T05:49:46.678 INFO:tasks.ceph.osd.3.smithi151.stderr:2022-03-15T05:49:46.675+0000 7f709cb70700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-15T05:49:46.809 INFO:tasks.ceph.osd.2.smithi151.stderr:2022-03-15T05:49:46.806+0000 7feaa8931700 -1 osd.2 0 waiting for initial osdmap 2022-03-15T05:49:46.815 INFO:tasks.ceph.osd.2.smithi151.stderr:2022-03-15T05:49:46.812+0000 7feaa12c3700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-15T05:49:46.913 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.910+0000 7f4e1d080700 1 -- 172.21.15.151:0/1985850098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e180bf900 con 0x7f4e18068c90 2022-03-15T05:49:46.914 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.911+0000 7f4dfffff700 1 -- 172.21.15.151:0/1985850098 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9571 (secure 0 0 0) 0x7f4e0c04dc30 con 0x7f4e18068c90 2022-03-15T05:49:46.914 INFO:teuthology.misc.health.smithi151.stdout: 2022-03-15T05:49:46.915 INFO:teuthology.misc.health.smithi151.stdout:{"epoch":14,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:49:46.303165+0000","last_up_change":"2022-03-15T05:49:46.303165+0000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":35552},{"type":"v1","addr":"172.21.15.151:6801","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":35552},{"type":"v1","addr":"172.21.15.151:6803","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":35552},{"type":"v1","addr":"172.21.15.151:6807","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":35552},{"type":"v1","addr":"172.21.15.151:6805","nonce":35552}]},"public_addr":"172.21.15.151:6801/35552","cluster_addr":"172.21.15.151:6803/35552","heartbeat_back_addr":"172.21.15.151:6807/35552","heartbeat_front_addr":"172.21.15.151:6805/35552","state":["exists","up"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":35554},{"type":"v1","addr":"172.21.15.151:6821","nonce":35554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":35554},{"type":"v1","addr":"172.21.15.151:6825","nonce":35554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":35554},{"type":"v1","addr":"172.21.15.151:6831","nonce":35554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":35554},{"type":"v1","addr":"172.21.15.151:6829","nonce":35554}]},"public_addr":"172.21.15.151:6821/35554","cluster_addr":"172.21.15.151:6825/35554","heartbeat_back_addr":"172.21.15.151:6831/35554","heartbeat_front_addr":"172.21.15.151:6829/35554","state":["exists","up"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":41130},{"type":"v1","addr":"172.21.15.164:6825","nonce":41130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":41130},{"type":"v1","addr":"172.21.15.164:6827","nonce":41130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":41130},{"type":"v1","addr":"172.21.15.164:6831","nonce":41130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":41130},{"type":"v1","addr":"172.21.15.164:6829","nonce":41130}]},"public_addr":"172.21.15.164:6825/41130","cluster_addr":"172.21.15.164:6827/41130","heartbeat_back_addr":"172.21.15.164:6831/41130","heartbeat_front_addr":"172.21.15.164:6829/41130","state":["exists","up"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":41119},{"type":"v1","addr":"172.21.15.164:6801","nonce":41119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":41119},{"type":"v1","addr":"172.21.15.164:6803","nonce":41119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":41119},{"type":"v1","addr":"172.21.15.164:6807","nonce":41119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":41119},{"type":"v1","addr":"172.21.15.164:6805","nonce":41119}]},"public_addr":"172.21.15.164:6801/41119","cluster_addr":"172.21.15.164:6803/41119","heartbeat_back_addr":"172.21.15.164:6807/41119","heartbeat_front_addr":"172.21.15.164:6805/41119","state":["exists","up"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":41129},{"type":"v1","addr":"172.21.15.164:6817","nonce":41129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":41129},{"type":"v1","addr":"172.21.15.164:6819","nonce":41129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":41129},{"type":"v1","addr":"172.21.15.164:6823","nonce":41129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":41129},{"type":"v1","addr":"172.21.15.164:6821","nonce":41129}]},"public_addr":"172.21.15.164:6817/41129","cluster_addr":"172.21.15.164:6819/41129","heartbeat_back_addr":"172.21.15.164:6823/41129","heartbeat_front_addr":"172.21.15.164:6821/41129","state":["exists","up"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":41120},{"type":"v1","addr":"172.21.15.164:6809","nonce":41120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":41120},{"type":"v1","addr":"172.21.15.164:6811","nonce":41120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":41120},{"type":"v1","addr":"172.21.15.164:6816","nonce":41120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":41120},{"type":"v1","addr":"172.21.15.164:6813","nonce":41120}]},"public_addr":"172.21.15.164:6809/41120","cluster_addr":"172.21.15.164:6811/41120","heartbeat_back_addr":"172.21.15.164:6816/41120","heartbeat_front_addr":"172.21.15.164:6813/41120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:49:46.917 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 -- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4df8063440 msgr2=0x7f4df80658f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:46.917 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4df8063440 0x7f4df80658f0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4e08006fd0 tx=0x7f4e08016000 comp rx=0 tx=0).stop 2022-03-15T05:49:46.917 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 -- 172.21.15.151:0/1985850098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 msgr2=0x7f4e180a67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:46.917 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 0x7f4e180a67b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4e0c00c440 tx=0x7f4e0c007dc0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.918 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 -- 172.21.15.151:0/1985850098 shutdown_connections 2022-03-15T05:49:46.918 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4df8063440 0x7f4df80658f0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.918 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e180bed90 0x7f4e18166150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.918 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e18067f40 0x7f4e180c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.919 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 --2- 172.21.15.151:0/1985850098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e18068c90 0x7f4e180a67b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:46.919 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 -- 172.21.15.151:0/1985850098 >> 172.21.15.151:0/1985850098 conn(0x7f4e1806eb80 msgr2=0x7f4e18150aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:46.919 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.913+0000 7f4e1d080700 1 -- 172.21.15.151:0/1985850098 shutdown_connections 2022-03-15T05:49:46.919 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:46.914+0000 7f4e1d080700 1 -- 172.21.15.151:0/1985850098 wait complete. 2022-03-15T05:49:46.937 DEBUG:teuthology.misc:6 of 8 OSDs are up 2022-03-15T05:49:53.743 DEBUG:teuthology.orchestra.run.smithi151:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2022-03-15T05:49:53.933 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.930+0000 7f03f81fb700 1 Processor -- start 2022-03-15T05:49:53.933 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.930+0000 7f03f81fb700 1 -- start start 2022-03-15T05:49:53.936 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.931+0000 7f03f81fb700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f03f0066980 0x7f03f0156150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:53.937 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.931+0000 7f03f81fb700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f03f006e040 0x7f03f01556c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:53.937 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.931+0000 7f03f81fb700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03f006dbb0 con 0x7f03f00be6d0 2022-03-15T05:49:53.937 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.931+0000 7f03f81fb700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f0155c00 con 0x7f03f0066980 2022-03-15T05:49:53.937 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.931+0000 7f03f81fb700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03f006ec30 con 0x7f03f006e040 2022-03-15T05:49:53.938 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.931+0000 7f03f5f97700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f03f0066980 0x7f03f0156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:53.938 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.931+0000 7f03f6798700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f03f006e040 0x7f03f01556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:53.938 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.931+0000 7f03f5796700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f03f00be6d0 0x7f03f0066d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53142/0 (socket says 172.21.15.151:53142) 2022-03-15T05:49:53.939 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.932+0000 7f03f5796700 1 -- 172.21.15.151:0/1898957670 learned_addr learned my addr 172.21.15.151:0/1898957670 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:53.939 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.932+0000 7f03f6798700 1 -- 172.21.15.151:0/1898957670 >> v2:172.21.15.151:3300/0 conn(0x7f03f0066980 msgr2=0x7f03f0156150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:53.939 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.932+0000 7f03f6798700 1 --2- 172.21.15.151:0/1898957670 >> v2:172.21.15.151:3300/0 conn(0x7f03f0066980 0x7f03f0156150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:53.939 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.932+0000 7f03f6798700 1 -- 172.21.15.151:0/1898957670 >> v1:172.21.15.151:6789/0 conn(0x7f03f00be6d0 legacy=0x7f03f0066d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:53.940 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.932+0000 7f03f6798700 1 -- 172.21.15.151:0/1898957670 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03f006eef0 con 0x7f03f006e040 2022-03-15T05:49:53.940 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.932+0000 7f03f5f97700 1 --2- 172.21.15.151:0/1898957670 >> v2:172.21.15.151:3300/0 conn(0x7f03f0066980 0x7f03f0156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:53.940 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.932+0000 7f03f6798700 1 --2- 172.21.15.151:0/1898957670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03f006e040 0x7f03f01556c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f03f006c4f0 tx=0x7f03e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e5519b150c0a92b server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:53.940 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f4f95700 1 -- 172.21.15.151:0/1898957670 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e800e070 con 0x7f03f006e040 2022-03-15T05:49:53.940 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f4f95700 1 -- 172.21.15.151:0/1898957670 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e800bb60 con 0x7f03f006e040 2022-03-15T05:49:53.941 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f4f95700 1 -- 172.21.15.151:0/1898957670 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e8012430 con 0x7f03f006e040 2022-03-15T05:49:53.941 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f81fb700 1 -- 172.21.15.151:0/1898957670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03f006e040 msgr2=0x7f03f01556c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:53.941 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f81fb700 1 --2- 172.21.15.151:0/1898957670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03f006e040 0x7f03f01556c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f03f006c4f0 tx=0x7f03e8009780 comp rx=0 tx=0).stop 2022-03-15T05:49:53.941 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f81fb700 1 -- 172.21.15.151:0/1898957670 shutdown_connections 2022-03-15T05:49:53.942 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f81fb700 1 --2- 172.21.15.151:0/1898957670 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03f006e040 0x7f03f01556c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:53.942 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f81fb700 1 --2- 172.21.15.151:0/1898957670 >> v2:172.21.15.151:3300/0 conn(0x7f03f0066980 0x7f03f0156150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:53.942 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f81fb700 1 -- 172.21.15.151:0/1898957670 >> 172.21.15.151:0/1898957670 conn(0x7f03f00c7ca0 msgr2=0x7f03f00c80a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:53.942 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f81fb700 1 -- 172.21.15.151:0/1898957670 shutdown_connections 2022-03-15T05:49:53.943 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.933+0000 7f03f81fb700 1 -- 172.21.15.151:0/1898957670 wait complete. 2022-03-15T05:49:53.946 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.935+0000 7f03f81fb700 1 Processor -- start 2022-03-15T05:49:53.947 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.935+0000 7f03f81fb700 1 -- start start 2022-03-15T05:49:53.947 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f81fb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03f0066980 0x7f03f01652d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:53.947 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f81fb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03f006e040 0x7f03f00c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:53.947 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f81fb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03f00be6d0 0x7f03f00c10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:53.952 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f81fb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00c0c40 con 0x7f03f006e040 2022-03-15T05:49:53.952 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f81fb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00a9ca0 con 0x7f03f00be6d0 2022-03-15T05:49:53.952 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f81fb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03f00a9f80 con 0x7f03f0066980 2022-03-15T05:49:53.952 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f5796700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03f006e040 0x7f03f00c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:53.952 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f5f97700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03f0066980 0x7f03f01652d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:53.953 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f5796700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03f006e040 0x7f03f00c4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59914/0 (socket says 172.21.15.151:59914) 2022-03-15T05:49:53.953 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f6798700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03f00be6d0 0x7f03f00c10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:53.953 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.936+0000 7f03f5796700 1 -- 172.21.15.151:0/1032676188 learned_addr learned my addr 172.21.15.151:0/1032676188 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:53.953 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.937+0000 7f03f5796700 1 -- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03f0066980 msgr2=0x7f03f01652d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:53.954 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.937+0000 7f03f5796700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03f0066980 0x7f03f01652d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:53.954 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.937+0000 7f03f5796700 1 -- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03f00be6d0 msgr2=0x7f03f00c10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:53.954 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.937+0000 7f03f5796700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03f00be6d0 0x7f03f00c10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:53.954 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.937+0000 7f03f5796700 1 -- 172.21.15.151:0/1032676188 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03ec0092a0 con 0x7f03f006e040 2022-03-15T05:49:53.955 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.937+0000 7f03f6798700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03f00be6d0 0x7f03f00c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:53.955 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.937+0000 7f03f5796700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03f006e040 0x7f03f00c4860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f03e000c440 tx=0x7f03e0007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:53.955 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.937+0000 7f03ddffb700 1 -- 172.21.15.151:0/1032676188 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e00072e0 con 0x7f03f006e040 2022-03-15T05:49:53.955 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.937+0000 7f03ddffb700 1 -- 172.21.15.151:0/1032676188 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03e0007440 con 0x7f03f006e040 2022-03-15T05:49:53.956 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.938+0000 7f03f81fb700 1 -- 172.21.15.151:0/1032676188 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e8009a20 con 0x7f03f006e040 2022-03-15T05:49:53.956 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.938+0000 7f03ddffb700 1 -- 172.21.15.151:0/1032676188 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03e0005030 con 0x7f03f006e040 2022-03-15T05:49:53.956 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.938+0000 7f03f81fb700 1 -- 172.21.15.151:0/1032676188 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03f00aa540 con 0x7f03f006e040 2022-03-15T05:49:53.956 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.939+0000 7f03f81fb700 1 -- 172.21.15.151:0/1032676188 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03f006c000 con 0x7f03f006e040 2022-03-15T05:49:53.956 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.940+0000 7f03ddffb700 1 -- 172.21.15.151:0/1032676188 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f03e0010070 con 0x7f03f006e040 2022-03-15T05:49:53.957 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.941+0000 7f03ddffb700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f03d00633c0 0x7f03d0065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:53.957 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.941+0000 7f03ddffb700 1 -- 172.21.15.151:0/1032676188 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f03e007e960 con 0x7f03f006e040 2022-03-15T05:49:53.957 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.941+0000 7f03f5f97700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f03d00633c0 0x7f03d0065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:53.957 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.942+0000 7f03f5f97700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f03d00633c0 0x7f03d0065870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009dc0 tx=0x7f03ec009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:53.958 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:53.946+0000 7f03ddffb700 1 -- 172.21.15.151:0/1032676188 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f03e004ddf0 con 0x7f03f006e040 2022-03-15T05:49:54.140 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.137+0000 7f03f81fb700 1 -- 172.21.15.151:0/1032676188 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03f006cf90 con 0x7f03f006e040 2022-03-15T05:49:54.140 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.138+0000 7f03ddffb700 1 -- 172.21.15.151:0/1032676188 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12154 (secure 0 0 0) 0x7f03e0051410 con 0x7f03f006e040 2022-03-15T05:49:54.141 INFO:teuthology.misc.health.smithi151.stdout: 2022-03-15T05:49:54.141 INFO:teuthology.misc.health.smithi151.stdout:{"epoch":17,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:49:49.313220+0000","last_up_change":"2022-03-15T05:49:47.305366+0000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-03-15T05:49:46.741897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":35552},{"type":"v1","addr":"172.21.15.151:6801","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":35552},{"type":"v1","addr":"172.21.15.151:6803","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":35552},{"type":"v1","addr":"172.21.15.151:6807","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":35552},{"type":"v1","addr":"172.21.15.151:6805","nonce":35552}]},"public_addr":"172.21.15.151:6801/35552","cluster_addr":"172.21.15.151:6803/35552","heartbeat_back_addr":"172.21.15.151:6807/35552","heartbeat_front_addr":"172.21.15.151:6805/35552","state":["exists","up"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":35554},{"type":"v1","addr":"172.21.15.151:6821","nonce":35554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":35554},{"type":"v1","addr":"172.21.15.151:6825","nonce":35554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":35554},{"type":"v1","addr":"172.21.15.151:6831","nonce":35554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":35554},{"type":"v1","addr":"172.21.15.151:6829","nonce":35554}]},"public_addr":"172.21.15.151:6821/35554","cluster_addr":"172.21.15.151:6825/35554","heartbeat_back_addr":"172.21.15.151:6831/35554","heartbeat_front_addr":"172.21.15.151:6829/35554","state":["exists","up"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":35555},{"type":"v1","addr":"172.21.15.151:6817","nonce":35555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":35555},{"type":"v1","addr":"172.21.15.151:6820","nonce":35555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":35555},{"type":"v1","addr":"172.21.15.151:6828","nonce":35555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":35555},{"type":"v1","addr":"172.21.15.151:6824","nonce":35555}]},"public_addr":"172.21.15.151:6817/35555","cluster_addr":"172.21.15.151:6820/35555","heartbeat_back_addr":"172.21.15.151:6828/35555","heartbeat_front_addr":"172.21.15.151:6824/35555","state":["exists","up"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":35553},{"type":"v1","addr":"172.21.15.151:6809","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":35553},{"type":"v1","addr":"172.21.15.151:6811","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":35553},{"type":"v1","addr":"172.21.15.151:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":35553},{"type":"v1","addr":"172.21.15.151:6813","nonce":35553}]},"public_addr":"172.21.15.151:6809/35553","cluster_addr":"172.21.15.151:6811/35553","heartbeat_back_addr":"172.21.15.151:6815/35553","heartbeat_front_addr":"172.21.15.151:6813/35553","state":["exists","up"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":41130},{"type":"v1","addr":"172.21.15.164:6825","nonce":41130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":41130},{"type":"v1","addr":"172.21.15.164:6827","nonce":41130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":41130},{"type":"v1","addr":"172.21.15.164:6831","nonce":41130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":41130},{"type":"v1","addr":"172.21.15.164:6829","nonce":41130}]},"public_addr":"172.21.15.164:6825/41130","cluster_addr":"172.21.15.164:6827/41130","heartbeat_back_addr":"172.21.15.164:6831/41130","heartbeat_front_addr":"172.21.15.164:6829/41130","state":["exists","up"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":41119},{"type":"v1","addr":"172.21.15.164:6801","nonce":41119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":41119},{"type":"v1","addr":"172.21.15.164:6803","nonce":41119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":41119},{"type":"v1","addr":"172.21.15.164:6807","nonce":41119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":41119},{"type":"v1","addr":"172.21.15.164:6805","nonce":41119}]},"public_addr":"172.21.15.164:6801/41119","cluster_addr":"172.21.15.164:6803/41119","heartbeat_back_addr":"172.21.15.164:6807/41119","heartbeat_front_addr":"172.21.15.164:6805/41119","state":["exists","up"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":41129},{"type":"v1","addr":"172.21.15.164:6817","nonce":41129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":41129},{"type":"v1","addr":"172.21.15.164:6819","nonce":41129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":41129},{"type":"v1","addr":"172.21.15.164:6823","nonce":41129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":41129},{"type":"v1","addr":"172.21.15.164:6821","nonce":41129}]},"public_addr":"172.21.15.164:6817/41129","cluster_addr":"172.21.15.164:6819/41129","heartbeat_back_addr":"172.21.15.164:6823/41129","heartbeat_front_addr":"172.21.15.164:6821/41129","state":["exists","up"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":41120},{"type":"v1","addr":"172.21.15.164:6809","nonce":41120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":41120},{"type":"v1","addr":"172.21.15.164:6811","nonce":41120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":41120},{"type":"v1","addr":"172.21.15.164:6816","nonce":41120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":41120},{"type":"v1","addr":"172.21.15.164:6813","nonce":41120}]},"public_addr":"172.21.15.164:6809/41120","cluster_addr":"172.21.15.164:6811/41120","heartbeat_back_addr":"172.21.15.164:6816/41120","heartbeat_front_addr":"172.21.15.164:6813/41120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.378836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.466901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.764352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.688587+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.304917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.236409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.231122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.208581+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:49:54.144 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 -- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f03d00633c0 msgr2=0x7f03d0065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.144 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f03d00633c0 0x7f03d0065870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009dc0 tx=0x7f03ec009060 comp rx=0 tx=0).stop 2022-03-15T05:49:54.144 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 -- 172.21.15.151:0/1032676188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03f006e040 msgr2=0x7f03f00c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.145 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03f006e040 0x7f03f00c4860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f03e000c440 tx=0x7f03e0007dc0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.145 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 -- 172.21.15.151:0/1032676188 shutdown_connections 2022-03-15T05:49:54.145 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f03d00633c0 0x7f03d0065870 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.145 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f03f00be6d0 0x7f03f00c10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.145 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f03f0066980 0x7f03f01652d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.146 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 --2- 172.21.15.151:0/1032676188 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f03f006e040 0x7f03f00c4860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.146 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 -- 172.21.15.151:0/1032676188 >> 172.21.15.151:0/1032676188 conn(0x7f03f00c7ca0 msgr2=0x7f03f0156720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:54.146 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 -- 172.21.15.151:0/1032676188 shutdown_connections 2022-03-15T05:49:54.146 INFO:teuthology.misc.health.smithi151.stderr:2022-03-15T05:49:54.140+0000 7f03f81fb700 1 -- 172.21.15.151:0/1032676188 wait complete. 2022-03-15T05:49:54.165 DEBUG:teuthology.misc:8 of 8 OSDs are up 2022-03-15T05:49:54.165 INFO:tasks.ceph:Creating RBD pool 2022-03-15T05:49:54.166 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd pool create rbd 8 2022-03-15T05:49:54.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.361+0000 7f4e3cb65700 1 Processor -- start 2022-03-15T05:49:54.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.361+0000 7f4e3cb65700 1 -- start start 2022-03-15T05:49:54.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.362+0000 7f4e3cb65700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4e38153740 0x7f4e380c7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:54.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.362+0000 7f4e3cb65700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e380c7980 con 0x7f4e3814cd00 2022-03-15T05:49:54.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e3cb65700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e380c0060 con 0x7f4e380c0d40 2022-03-15T05:49:54.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e3cb65700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e38152be0 con 0x7f4e38153740 2022-03-15T05:49:54.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e3659c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f4e3814cd00 0x7f4e3806e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53144/0 (socket says 172.21.15.151:53144) 2022-03-15T05:49:54.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e3659c700 1 -- 172.21.15.151:0/1596986452 learned_addr learned my addr 172.21.15.151:0/1596986452 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:54.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e36d9d700 1 --2- 172.21.15.151:0/1596986452 >> v2:172.21.15.164:3300/0 conn(0x7f4e38153740 0x7f4e380c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:54.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e3559a700 1 -- 172.21.15.151:0/1596986452 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 196467410 0 0) 0x7f4e380c7980 con 0x7f4e3814cd00 2022-03-15T05:49:54.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e3559a700 1 -- 172.21.15.151:0/1596986452 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e1c0033f0 con 0x7f4e3814cd00 2022-03-15T05:49:54.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e3559a700 1 -- 172.21.15.151:0/1596986452 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 980569043 0 0) 0x7f4e380c0060 con 0x7f4e380c0d40 2022-03-15T05:49:54.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e3559a700 1 -- 172.21.15.151:0/1596986452 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e380c7980 con 0x7f4e380c0d40 2022-03-15T05:49:54.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e36d9d700 1 -- 172.21.15.151:0/1596986452 >> v1:172.21.15.164:6789/0 conn(0x7f4e380c0d40 legacy=0x7f4e38153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e36d9d700 1 -- 172.21.15.151:0/1596986452 >> v1:172.21.15.151:6789/0 conn(0x7f4e3814cd00 legacy=0x7f4e3806e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.363+0000 7f4e36d9d700 1 -- 172.21.15.151:0/1596986452 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e380c0340 con 0x7f4e38153740 2022-03-15T05:49:54.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.364+0000 7f4e36d9d700 1 --2- 172.21.15.151:0/1596986452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e38153740 0x7f4e380c7340 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009e60 tx=0x7f4e30009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be9b0ddcf0ece996 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:54.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.364+0000 7f4e3559a700 1 -- 172.21.15.151:0/1596986452 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000e070 con 0x7f4e38153740 2022-03-15T05:49:54.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.364+0000 7f4e3559a700 1 -- 172.21.15.151:0/1596986452 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3000bab0 con 0x7f4e38153740 2022-03-15T05:49:54.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.364+0000 7f4e3559a700 1 -- 172.21.15.151:0/1596986452 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000be70 con 0x7f4e38153740 2022-03-15T05:49:54.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.364+0000 7f4e3cb65700 1 -- 172.21.15.151:0/1596986452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e38153740 msgr2=0x7f4e380c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.364+0000 7f4e3cb65700 1 --2- 172.21.15.151:0/1596986452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e38153740 0x7f4e380c7340 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009e60 tx=0x7f4e30009780 comp rx=0 tx=0).stop 2022-03-15T05:49:54.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.365+0000 7f4e3cb65700 1 -- 172.21.15.151:0/1596986452 shutdown_connections 2022-03-15T05:49:54.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.365+0000 7f4e3cb65700 1 --2- 172.21.15.151:0/1596986452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e38153740 0x7f4e380c7340 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.365+0000 7f4e3cb65700 1 -- 172.21.15.151:0/1596986452 >> 172.21.15.151:0/1596986452 conn(0x7f4e3806aa60 msgr2=0x7f4e380c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:54.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.365+0000 7f4e3cb65700 1 -- 172.21.15.151:0/1596986452 shutdown_connections 2022-03-15T05:49:54.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.365+0000 7f4e3cb65700 1 -- 172.21.15.151:0/1596986452 wait complete. 2022-03-15T05:49:54.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.366+0000 7f4e3cb65700 1 Processor -- start 2022-03-15T05:49:54.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.366+0000 7f4e3cb65700 1 -- start start 2022-03-15T05:49:54.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.367+0000 7f4e3cb65700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e380c0d40 0x7f4e38167df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:54.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.367+0000 7f4e3cb65700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e3814cd00 0x7f4e38168330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:54.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.367+0000 7f4e3cb65700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e38153740 0x7f4e3806c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:54.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.367+0000 7f4e3cb65700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3814c220 con 0x7f4e38153740 2022-03-15T05:49:54.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.367+0000 7f4e3cb65700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3806c3a0 con 0x7f4e380c0d40 2022-03-15T05:49:54.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.367+0000 7f4e3cb65700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e381651b0 con 0x7f4e3814cd00 2022-03-15T05:49:54.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e36d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e38153740 0x7f4e3806c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:54.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e3659c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e380c0d40 0x7f4e38167df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:54.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e36d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e38153740 0x7f4e3806c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59916/0 (socket says 172.21.15.151:59916) 2022-03-15T05:49:54.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e36d9d700 1 -- 172.21.15.151:0/580858106 learned_addr learned my addr 172.21.15.151:0/580858106 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:54.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e35d9b700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e3814cd00 0x7f4e38168330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:54.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e36d9d700 1 -- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e3814cd00 msgr2=0x7f4e38168330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e36d9d700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e3814cd00 0x7f4e38168330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e36d9d700 1 -- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e380c0d40 msgr2=0x7f4e38167df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e36d9d700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e380c0d40 0x7f4e38167df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e36d9d700 1 -- 172.21.15.151:0/580858106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e30009a20 con 0x7f4e38153740 2022-03-15T05:49:54.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e3659c700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e380c0d40 0x7f4e38167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:54.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.368+0000 7f4e36d9d700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e38153740 0x7f4e3806c830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e3806b7f0 tx=0x7f4e30019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:54.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.369+0000 7f4e267fc700 1 -- 172.21.15.151:0/580858106 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30012dd0 con 0x7f4e38153740 2022-03-15T05:49:54.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.369+0000 7f4e267fc700 1 -- 172.21.15.151:0/580858106 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e30026480 con 0x7f4e38153740 2022-03-15T05:49:54.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.369+0000 7f4e3cb65700 1 -- 172.21.15.151:0/580858106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3814c450 con 0x7f4e38153740 2022-03-15T05:49:54.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.369+0000 7f4e267fc700 1 -- 172.21.15.151:0/580858106 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30026840 con 0x7f4e38153740 2022-03-15T05:49:54.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.369+0000 7f4e3cb65700 1 -- 172.21.15.151:0/580858106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e38165450 con 0x7f4e38153740 2022-03-15T05:49:54.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.370+0000 7f4e3cb65700 1 -- 172.21.15.151:0/580858106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3806c530 con 0x7f4e38153740 2022-03-15T05:49:54.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.371+0000 7f4e267fc700 1 -- 172.21.15.151:0/580858106 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f4e3001c400 con 0x7f4e38153740 2022-03-15T05:49:54.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.372+0000 7f4e267fc700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4e140633f0 0x7f4e140658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:54.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.372+0000 7f4e267fc700 1 -- 172.21.15.151:0/580858106 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4e30081860 con 0x7f4e38153740 2022-03-15T05:49:54.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.372+0000 7f4e3659c700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4e140633f0 0x7f4e140658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:54.384 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.373+0000 7f4e3659c700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4e140633f0 0x7f4e140658a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e28007fd0 tx=0x7f4e28009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:54.384 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.376+0000 7f4e267fc700 1 -- 172.21.15.151:0/580858106 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f4e30050ce0 con 0x7f4e38153740 2022-03-15T05:49:54.563 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.561+0000 7f4e3cb65700 1 -- 172.21.15.151:0/580858106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f4e3804b760 con 0x7f4e38153740 2022-03-15T05:49:54.709 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.706+0000 7f4e267fc700 1 -- 172.21.15.151:0/580858106 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f4e3002b0a0 con 0x7f4e38153740 2022-03-15T05:49:54.712 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 -- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4e140633f0 msgr2=0x7f4e140658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.713 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4e140633f0 0x7f4e140658a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4e28007fd0 tx=0x7f4e28009040 comp rx=0 tx=0).stop 2022-03-15T05:49:54.713 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 -- 172.21.15.151:0/580858106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e38153740 msgr2=0x7f4e3806c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.713 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e38153740 0x7f4e3806c830 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4e3806b7f0 tx=0x7f4e30019000 comp rx=0 tx=0).stop 2022-03-15T05:49:54.713 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 -- 172.21.15.151:0/580858106 shutdown_connections 2022-03-15T05:49:54.714 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4e140633f0 0x7f4e140658a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.714 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e38153740 0x7f4e3806c830 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.714 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e380c0d40 0x7f4e38167df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.714 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 --2- 172.21.15.151:0/580858106 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4e3814cd00 0x7f4e38168330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.714 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 -- 172.21.15.151:0/580858106 >> 172.21.15.151:0/580858106 conn(0x7f4e3806aa60 msgr2=0x7f4e38066980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 -- 172.21.15.151:0/580858106 shutdown_connections 2022-03-15T05:49:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.709+0000 7f4e3cb65700 1 -- 172.21.15.151:0/580858106 wait complete. 2022-03-15T05:49:54.715 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'rbd' created 2022-03-15T05:49:54.736 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2022-03-15T05:49:54.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:49:54.796 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:49:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.941+0000 7f702d776700 1 Processor -- start 2022-03-15T05:49:54.944 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.941+0000 7f702d776700 1 -- start start 2022-03-15T05:49:54.946 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.942+0000 7f702d776700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7028067700 0x7f702815d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:54.947 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.942+0000 7f702d776700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702806a1f0 con 0x7f70280c0240 2022-03-15T05:49:54.947 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.942+0000 7f702d776700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7028155750 con 0x7f70280c0610 2022-03-15T05:49:54.947 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.942+0000 7f702d776700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f702814c0f0 con 0x7f7028067700 2022-03-15T05:49:54.947 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.943+0000 7f7026ffd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f70280c0240 0x7f7028151830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53146/0 (socket says 172.21.15.151:53146) 2022-03-15T05:49:54.947 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.943+0000 7f7026ffd700 1 -- 172.21.15.151:0/3464883401 learned_addr learned my addr 172.21.15.151:0/3464883401 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:54.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.943+0000 7f70277fe700 1 --2- 172.21.15.151:0/3464883401 >> v2:172.21.15.151:3300/0 conn(0x7f7028067700 0x7f702815d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:54.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.943+0000 7f7025ffb700 1 -- 172.21.15.151:0/3464883401 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307401955 0 0) 0x7f7028155750 con 0x7f70280c0610 2022-03-15T05:49:54.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.943+0000 7f7025ffb700 1 -- 172.21.15.151:0/3464883401 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70140033f0 con 0x7f70280c0610 2022-03-15T05:49:54.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.943+0000 7f7025ffb700 1 -- 172.21.15.151:0/3464883401 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 432057793 0 0) 0x7f702806a1f0 con 0x7f70280c0240 2022-03-15T05:49:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.943+0000 7f7025ffb700 1 -- 172.21.15.151:0/3464883401 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7028155750 con 0x7f70280c0240 2022-03-15T05:49:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.943+0000 7f70277fe700 1 -- 172.21.15.151:0/3464883401 >> v1:172.21.15.164:6789/0 conn(0x7f70280c0610 legacy=0x7f70280c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.943+0000 7f70277fe700 1 -- 172.21.15.151:0/3464883401 >> v1:172.21.15.151:6789/0 conn(0x7f70280c0240 legacy=0x7f7028151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.943+0000 7f70277fe700 1 -- 172.21.15.151:0/3464883401 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7028155be0 con 0x7f7028067700 2022-03-15T05:49:54.949 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.944+0000 7f70277fe700 1 --2- 172.21.15.151:0/3464883401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7028067700 0x7f702815d0d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7020009e60 tx=0x7f7020009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb74a370bf5e9a5 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:54.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.944+0000 7f7025ffb700 1 -- 172.21.15.151:0/3464883401 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000e070 con 0x7f7028067700 2022-03-15T05:49:54.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.944+0000 7f7025ffb700 1 -- 172.21.15.151:0/3464883401 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f702000bab0 con 0x7f7028067700 2022-03-15T05:49:54.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.944+0000 7f7025ffb700 1 -- 172.21.15.151:0/3464883401 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702000be30 con 0x7f7028067700 2022-03-15T05:49:54.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.944+0000 7f702d776700 1 -- 172.21.15.151:0/3464883401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7028067700 msgr2=0x7f702815d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.944+0000 7f702d776700 1 --2- 172.21.15.151:0/3464883401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7028067700 0x7f702815d0d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7020009e60 tx=0x7f7020009780 comp rx=0 tx=0).stop 2022-03-15T05:49:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.945+0000 7f702d776700 1 -- 172.21.15.151:0/3464883401 shutdown_connections 2022-03-15T05:49:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.945+0000 7f702d776700 1 --2- 172.21.15.151:0/3464883401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7028067700 0x7f702815d0d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.945+0000 7f702d776700 1 -- 172.21.15.151:0/3464883401 >> 172.21.15.151:0/3464883401 conn(0x7f7028066980 msgr2=0x7f7028066d80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:54.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.945+0000 7f702d776700 1 -- 172.21.15.151:0/3464883401 shutdown_connections 2022-03-15T05:49:54.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.945+0000 7f702d776700 1 -- 172.21.15.151:0/3464883401 wait complete. 2022-03-15T05:49:54.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.946+0000 7f702d776700 1 Processor -- start 2022-03-15T05:49:54.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.946+0000 7f702d776700 1 -- start start 2022-03-15T05:49:54.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.947+0000 7f702d776700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7028067700 0x7f702814dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:54.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.947+0000 7f702d776700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70280c0240 0x7f7028160b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:54.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.947+0000 7f702d776700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70281552a0 0x7f7028144820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:54.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.947+0000 7f702d776700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70281606b0 con 0x7f70280c0240 2022-03-15T05:49:54.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.947+0000 7f702d776700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70280c1a60 con 0x7f7028067700 2022-03-15T05:49:54.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.947+0000 7f702d776700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7028160080 con 0x7f70281552a0 2022-03-15T05:49:54.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.947+0000 7f70267fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70280c0240 0x7f7028160b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:54.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f7026ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7028067700 0x7f702814dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:54.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f70267fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70280c0240 0x7f7028160b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59922/0 (socket says 172.21.15.151:59922) 2022-03-15T05:49:54.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f70267fc700 1 -- 172.21.15.151:0/529886610 learned_addr learned my addr 172.21.15.151:0/529886610 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:54.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f70277fe700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70281552a0 0x7f7028144820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:54.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f70267fc700 1 -- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70281552a0 msgr2=0x7f7028144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f70267fc700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70281552a0 0x7f7028144820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f70267fc700 1 -- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7028067700 msgr2=0x7f702814dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:54.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f70267fc700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7028067700 0x7f702814dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:54.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f70267fc700 1 -- 172.21.15.151:0/529886610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7020009a20 con 0x7f70280c0240 2022-03-15T05:49:54.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f70267fc700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70280c0240 0x7f7028160b40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c440 tx=0x7f701c007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:54.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.948+0000 7f700effd700 1 -- 172.21.15.151:0/529886610 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c0050d0 con 0x7f70280c0240 2022-03-15T05:49:54.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.949+0000 7f700effd700 1 -- 172.21.15.151:0/529886610 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c005250 con 0x7f70280c0240 2022-03-15T05:49:54.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.949+0000 7f700effd700 1 -- 172.21.15.151:0/529886610 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c0053c0 con 0x7f70280c0240 2022-03-15T05:49:54.960 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.949+0000 7f702d776700 1 -- 172.21.15.151:0/529886610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70280c1d00 con 0x7f70280c0240 2022-03-15T05:49:54.960 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.949+0000 7f702d776700 1 -- 172.21.15.151:0/529886610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7028144d60 con 0x7f70280c0240 2022-03-15T05:49:54.960 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.950+0000 7f702d776700 1 -- 172.21.15.151:0/529886610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7028160500 con 0x7f70280c0240 2022-03-15T05:49:54.961 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.951+0000 7f700effd700 1 -- 172.21.15.151:0/529886610 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f701c019030 con 0x7f70280c0240 2022-03-15T05:49:54.961 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.951+0000 7f700effd700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70080633c0 0x7f7008065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:54.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.952+0000 7f700effd700 1 -- 172.21.15.151:0/529886610 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f701c07ea60 con 0x7f70280c0240 2022-03-15T05:49:54.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.952+0000 7f7026ffd700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70080633c0 0x7f7008065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:54.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.953+0000 7f7026ffd700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70080633c0 0x7f7008065870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7018001010 tx=0x7f7018007cc0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:54.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:54.956+0000 7f700effd700 1 -- 172.21.15.151:0/529886610 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f701c04dd60 con 0x7f70280c0240 2022-03-15T05:49:55.144 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.141+0000 7f702d776700 1 -- 172.21.15.151:0/529886610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f702804b760 con 0x7f70280c0240 2022-03-15T05:49:55.711 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.708+0000 7f700effd700 1 -- 172.21.15.151:0/529886610 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f701c017020 con 0x7f70280c0240 2022-03-15T05:49:55.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 -- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70080633c0 msgr2=0x7f7008065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:55.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70080633c0 0x7f7008065870 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7018001010 tx=0x7f7018007cc0 comp rx=0 tx=0).stop 2022-03-15T05:49:55.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 -- 172.21.15.151:0/529886610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70280c0240 msgr2=0x7f7028160b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:55.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70280c0240 0x7f7028160b40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f701c00c440 tx=0x7f701c007c90 comp rx=0 tx=0).stop 2022-03-15T05:49:55.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 -- 172.21.15.151:0/529886610 shutdown_connections 2022-03-15T05:49:55.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70080633c0 0x7f7008065870 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:55.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70281552a0 0x7f7028144820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:55.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7028067700 0x7f702814dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:55.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 --2- 172.21.15.151:0/529886610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70280c0240 0x7f7028160b40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:55.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 -- 172.21.15.151:0/529886610 >> 172.21.15.151:0/529886610 conn(0x7f7028066980 msgr2=0x7f70280c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:55.718 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.712+0000 7f702d776700 1 -- 172.21.15.151:0/529886610 shutdown_connections 2022-03-15T05:49:55.718 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:55.713+0000 7f702d776700 1 -- 172.21.15.151:0/529886610 wait complete. 2022-03-15T05:49:55.718 INFO:teuthology.orchestra.run.smithi151.stderr:enabled application 'rbd' on pool 'rbd' 2022-03-15T05:49:55.742 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2022-03-15T05:49:55.742 INFO:tasks.ceph.mds.a:Restarting daemon 2022-03-15T05:49:55.743 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2022-03-15T05:49:55.747 INFO:tasks.ceph.mds.a:Started 2022-03-15T05:49:55.748 INFO:tasks.ceph.mds.c:Restarting daemon 2022-03-15T05:49:55.748 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2022-03-15T05:49:55.752 INFO:tasks.ceph.mds.c:Started 2022-03-15T05:49:55.753 INFO:tasks.ceph.mds.e:Restarting daemon 2022-03-15T05:49:55.753 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2022-03-15T05:49:55.757 INFO:tasks.ceph.mds.e:Started 2022-03-15T05:49:55.758 INFO:tasks.ceph.mds.b:Restarting daemon 2022-03-15T05:49:55.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2022-03-15T05:49:55.761 INFO:tasks.ceph.mds.b:Started 2022-03-15T05:49:55.761 INFO:tasks.ceph.mds.d:Restarting daemon 2022-03-15T05:49:55.761 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2022-03-15T05:49:55.764 INFO:tasks.ceph.mds.d:Started 2022-03-15T05:49:55.764 INFO:tasks.ceph.mds.f:Restarting daemon 2022-03-15T05:49:55.765 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2022-03-15T05:49:55.767 INFO:tasks.ceph.mds.f:Started 2022-03-15T05:49:55.767 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2022-03-15T05:49:55.768 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-15T05:49:55.847 INFO:tasks.ceph.mds.b.smithi164.stdout:starting mds.b at 2022-03-15T05:49:55.848 INFO:tasks.ceph.mds.d.smithi164.stdout:starting mds.d at 2022-03-15T05:49:55.848 INFO:tasks.ceph.mds.f.smithi164.stdout:starting mds.f at 2022-03-15T05:49:55.924 INFO:tasks.ceph.mds.a.smithi151.stdout:starting mds.a at 2022-03-15T05:49:55.925 INFO:tasks.ceph.mds.c.smithi151.stdout:starting mds.c at 2022-03-15T05:49:55.958 INFO:tasks.ceph.mds.e.smithi151.stdout:starting mds.e at 2022-03-15T05:49:56.029 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.026+0000 7f135d15b700 1 Processor -- start 2022-03-15T05:49:56.029 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.026+0000 7f135d15b700 1 -- start start 2022-03-15T05:49:56.032 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.027+0000 7f135d15b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb1f0 0x7f13580c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.033 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.027+0000 7f135d15b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13580c27b0 con 0x7f1358155cf0 2022-03-15T05:49:56.033 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.027+0000 7f135d15b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1358156190 con 0x7f13580cb5c0 2022-03-15T05:49:56.033 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.027+0000 7f135d15b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13580c4f90 con 0x7f13580cb1f0 2022-03-15T05:49:56.033 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f135759e700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f1358155cf0 0x7f13580c58e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53152/0 (socket says 172.21.15.151:53152) 2022-03-15T05:49:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f135759e700 1 -- 172.21.15.151:0/2307982949 learned_addr learned my addr 172.21.15.151:0/2307982949 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f1356d9d700 1 --2- 172.21.15.151:0/2307982949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb1f0 0x7f13580c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f135659c700 1 --1- 172.21.15.151:0/2307982949 >> v1:172.21.15.164:6789/0 conn(0x7f13580cb5c0 0x7f13581566c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33620/0 (socket says 172.21.15.151:33620) 2022-03-15T05:49:56.034 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f1355d9b700 1 -- 172.21.15.151:0/2307982949 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3832875677 0 0) 0x7f1358156190 con 0x7f13580cb5c0 2022-03-15T05:49:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f1355d9b700 1 -- 172.21.15.151:0/2307982949 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13440033f0 con 0x7f13580cb5c0 2022-03-15T05:49:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f1355d9b700 1 -- 172.21.15.151:0/2307982949 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888595657 0 0) 0x7f13580c27b0 con 0x7f1358155cf0 2022-03-15T05:49:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f1355d9b700 1 -- 172.21.15.151:0/2307982949 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1358156190 con 0x7f1358155cf0 2022-03-15T05:49:56.035 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f1356d9d700 1 -- 172.21.15.151:0/2307982949 >> v1:172.21.15.164:6789/0 conn(0x7f13580cb5c0 legacy=0x7f13581566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f1356d9d700 1 -- 172.21.15.151:0/2307982949 >> v1:172.21.15.151:6789/0 conn(0x7f1358155cf0 legacy=0x7f13580c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.028+0000 7f1356d9d700 1 -- 172.21.15.151:0/2307982949 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13580c5270 con 0x7f13580cb1f0 2022-03-15T05:49:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.029+0000 7f1356d9d700 1 --2- 172.21.15.151:0/2307982949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb1f0 0x7f13580c34e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f13480097c0 tx=0x7f1348009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b842e2757d44e44 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.029+0000 7f1355d9b700 1 -- 172.21.15.151:0/2307982949 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13480105b0 con 0x7f13580cb1f0 2022-03-15T05:49:56.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.029+0000 7f1355d9b700 1 -- 172.21.15.151:0/2307982949 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1348010710 con 0x7f13580cb1f0 2022-03-15T05:49:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.029+0000 7f1355d9b700 1 -- 172.21.15.151:0/2307982949 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348010ad0 con 0x7f13580cb1f0 2022-03-15T05:49:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.029+0000 7f135d15b700 1 -- 172.21.15.151:0/2307982949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb1f0 msgr2=0x7f13580c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.029+0000 7f135d15b700 1 --2- 172.21.15.151:0/2307982949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb1f0 0x7f13580c34e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f13480097c0 tx=0x7f1348009060 comp rx=0 tx=0).stop 2022-03-15T05:49:56.037 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.029+0000 7f135d15b700 1 -- 172.21.15.151:0/2307982949 shutdown_connections 2022-03-15T05:49:56.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.029+0000 7f135d15b700 1 --2- 172.21.15.151:0/2307982949 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb1f0 0x7f13580c34e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.029+0000 7f135d15b700 1 -- 172.21.15.151:0/2307982949 >> 172.21.15.151:0/2307982949 conn(0x7f1358068e90 msgr2=0x7f1358069290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:56.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.029+0000 7f135d15b700 1 -- 172.21.15.151:0/2307982949 shutdown_connections 2022-03-15T05:49:56.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.030+0000 7f135d15b700 1 -- 172.21.15.151:0/2307982949 wait complete. 2022-03-15T05:49:56.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.031+0000 7f135d15b700 1 Processor -- start 2022-03-15T05:49:56.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.031+0000 7f135d15b700 1 -- start start 2022-03-15T05:49:56.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135d15b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13580cb1f0 0x7f13580c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135d15b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb5c0 0x7f135814fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.043 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135d15b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1358155cf0 0x7f1358150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.043 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135d15b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1358164e40 con 0x7f1358155cf0 2022-03-15T05:49:56.043 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135d15b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13580be6f0 con 0x7f13580cb1f0 2022-03-15T05:49:56.043 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135d15b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1358166290 con 0x7f13580cb5c0 2022-03-15T05:49:56.044 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1358155cf0 0x7f1358150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.044 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135659c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb5c0 0x7f135814fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.044 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f1356d9d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13580cb1f0 0x7f13580c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.044 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135659c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb5c0 0x7f135814fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60046/0 (socket says 172.21.15.151:60046) 2022-03-15T05:49:56.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135659c700 1 -- 172.21.15.151:0/589226836 learned_addr learned my addr 172.21.15.151:0/589226836 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:56.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f135759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1358155cf0 0x7f1358150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59936/0 (socket says 172.21.15.151:59936) 2022-03-15T05:49:56.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.032+0000 7f1356d9d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13580cb1f0 0x7f13580c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57164/0 (socket says 172.21.15.151:57164) 2022-03-15T05:49:56.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.033+0000 7f1356d9d700 1 -- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb5c0 msgr2=0x7f135814fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.033+0000 7f1356d9d700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb5c0 0x7f135814fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.046 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.033+0000 7f1356d9d700 1 -- 172.21.15.151:0/589226836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1358155cf0 msgr2=0x7f1358150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.046 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.033+0000 7f1356d9d700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1358155cf0 0x7f1358150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.046 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.033+0000 7f1356d9d700 1 -- 172.21.15.151:0/589226836 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13480092a0 con 0x7f13580cb1f0 2022-03-15T05:49:56.046 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.033+0000 7f135659c700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb5c0 0x7f135814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:56.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.033+0000 7f1356d9d700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13580cb1f0 0x7f13580c74f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1348015000 tx=0x7f1348016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:56.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.033+0000 7f133effd700 1 -- 172.21.15.151:0/589226836 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348006990 con 0x7f13580cb1f0 2022-03-15T05:49:56.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.033+0000 7f133effd700 1 -- 172.21.15.151:0/589226836 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1348009120 con 0x7f13580cb1f0 2022-03-15T05:49:56.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.034+0000 7f135d15b700 1 -- 172.21.15.151:0/589226836 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1358166570 con 0x7f13580cb1f0 2022-03-15T05:49:56.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.034+0000 7f133effd700 1 -- 172.21.15.151:0/589226836 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348010ad0 con 0x7f13580cb1f0 2022-03-15T05:49:56.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.034+0000 7f135d15b700 1 -- 172.21.15.151:0/589226836 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1358165050 con 0x7f13580cb1f0 2022-03-15T05:49:56.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.035+0000 7f135d15b700 1 -- 172.21.15.151:0/589226836 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13580700c0 con 0x7f13580cb1f0 2022-03-15T05:49:56.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.035+0000 7f133effd700 1 -- 172.21.15.151:0/589226836 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f134800f070 con 0x7f13580cb1f0 2022-03-15T05:49:56.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.036+0000 7f133effd700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f13380633c0 0x7f1338065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.036+0000 7f133effd700 1 -- 172.21.15.151:0/589226836 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f13480812a0 con 0x7f13580cb1f0 2022-03-15T05:49:56.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.037+0000 7f135659c700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f13380633c0 0x7f1338065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.037+0000 7f135659c700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f13380633c0 0x7f1338065870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f135815b720 tx=0x7f134c007c50 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:56.050 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.041+0000 7f133effd700 1 -- 172.21.15.151:0/589226836 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f1348050680 con 0x7f13580cb1f0 2022-03-15T05:49:56.229 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.226+0000 7f135d15b700 1 -- 172.21.15.151:0/589226836 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1358088260 con 0x7f13580cb1f0 2022-03-15T05:49:56.230 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.227+0000 7f133effd700 1 -- 172.21.15.151:0/589226836 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13687 (secure 0 0 0) 0x7f134802a070 con 0x7f13580cb1f0 2022-03-15T05:49:56.231 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:49:56.231 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":19,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:49:55.705731+0000","last_up_change":"2022-03-15T05:49:47.305366+0000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-03-15T05:49:46.741897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-03-15T05:49:54.617407+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":35552},{"type":"v1","addr":"172.21.15.151:6801","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":35552},{"type":"v1","addr":"172.21.15.151:6803","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":35552},{"type":"v1","addr":"172.21.15.151:6807","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":35552},{"type":"v1","addr":"172.21.15.151:6805","nonce":35552}]},"public_addr":"172.21.15.151:6801/35552","cluster_addr":"172.21.15.151:6803/35552","heartbeat_back_addr":"172.21.15.151:6807/35552","heartbeat_front_addr":"172.21.15.151:6805/35552","state":["exists","up"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":35554},{"type":"v1","addr":"172.21.15.151:6821","nonce":35554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":35554},{"type":"v1","addr":"172.21.15.151:6825","nonce":35554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":35554},{"type":"v1","addr":"172.21.15.151:6831","nonce":35554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":35554},{"type":"v1","addr":"172.21.15.151:6829","nonce":35554}]},"public_addr":"172.21.15.151:6821/35554","cluster_addr":"172.21.15.151:6825/35554","heartbeat_back_addr":"172.21.15.151:6831/35554","heartbeat_front_addr":"172.21.15.151:6829/35554","state":["exists","up"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":35555},{"type":"v1","addr":"172.21.15.151:6817","nonce":35555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":35555},{"type":"v1","addr":"172.21.15.151:6820","nonce":35555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":35555},{"type":"v1","addr":"172.21.15.151:6828","nonce":35555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":35555},{"type":"v1","addr":"172.21.15.151:6824","nonce":35555}]},"public_addr":"172.21.15.151:6817/35555","cluster_addr":"172.21.15.151:6820/35555","heartbeat_back_addr":"172.21.15.151:6828/35555","heartbeat_front_addr":"172.21.15.151:6824/35555","state":["exists","up"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":35553},{"type":"v1","addr":"172.21.15.151:6809","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":35553},{"type":"v1","addr":"172.21.15.151:6811","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":35553},{"type":"v1","addr":"172.21.15.151:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":35553},{"type":"v1","addr":"172.21.15.151:6813","nonce":35553}]},"public_addr":"172.21.15.151:6809/35553","cluster_addr":"172.21.15.151:6811/35553","heartbeat_back_addr":"172.21.15.151:6815/35553","heartbeat_front_addr":"172.21.15.151:6813/35553","state":["exists","up"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":41130},{"type":"v1","addr":"172.21.15.164:6825","nonce":41130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":41130},{"type":"v1","addr":"172.21.15.164:6827","nonce":41130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":41130},{"type":"v1","addr":"172.21.15.164:6831","nonce":41130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":41130},{"type":"v1","addr":"172.21.15.164:6829","nonce":41130}]},"public_addr":"172.21.15.164:6825/41130","cluster_addr":"172.21.15.164:6827/41130","heartbeat_back_addr":"172.21.15.164:6831/41130","heartbeat_front_addr":"172.21.15.164:6829/41130","state":["exists","up"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":41119},{"type":"v1","addr":"172.21.15.164:6801","nonce":41119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":41119},{"type":"v1","addr":"172.21.15.164:6803","nonce":41119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":41119},{"type":"v1","addr":"172.21.15.164:6807","nonce":41119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":41119},{"type":"v1","addr":"172.21.15.164:6805","nonce":41119}]},"public_addr":"172.21.15.164:6801/41119","cluster_addr":"172.21.15.164:6803/41119","heartbeat_back_addr":"172.21.15.164:6807/41119","heartbeat_front_addr":"172.21.15.164:6805/41119","state":["exists","up"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":41129},{"type":"v1","addr":"172.21.15.164:6817","nonce":41129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":41129},{"type":"v1","addr":"172.21.15.164:6819","nonce":41129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":41129},{"type":"v1","addr":"172.21.15.164:6823","nonce":41129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":41129},{"type":"v1","addr":"172.21.15.164:6821","nonce":41129}]},"public_addr":"172.21.15.164:6817/41129","cluster_addr":"172.21.15.164:6819/41129","heartbeat_back_addr":"172.21.15.164:6823/41129","heartbeat_front_addr":"172.21.15.164:6821/41129","state":["exists","up"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":41120},{"type":"v1","addr":"172.21.15.164:6809","nonce":41120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":41120},{"type":"v1","addr":"172.21.15.164:6811","nonce":41120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":41120},{"type":"v1","addr":"172.21.15.164:6816","nonce":41120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":41120},{"type":"v1","addr":"172.21.15.164:6813","nonce":41120}]},"public_addr":"172.21.15.164:6809/41120","cluster_addr":"172.21.15.164:6811/41120","heartbeat_back_addr":"172.21.15.164:6816/41120","heartbeat_front_addr":"172.21.15.164:6813/41120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.378836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.466901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.764352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.688587+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.304917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.236409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.231122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.208581+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:49:56.233 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 -- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f13380633c0 msgr2=0x7f1338065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.233 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f13380633c0 0x7f1338065870 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f135815b720 tx=0x7f134c007c50 comp rx=0 tx=0).stop 2022-03-15T05:49:56.234 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 -- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13580cb1f0 msgr2=0x7f13580c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.234 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13580cb1f0 0x7f13580c74f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1348015000 tx=0x7f1348016000 comp rx=0 tx=0).stop 2022-03-15T05:49:56.234 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 -- 172.21.15.151:0/589226836 shutdown_connections 2022-03-15T05:49:56.234 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f13380633c0 0x7f1338065870 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.235 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1358155cf0 0x7f1358150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.235 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f13580cb1f0 0x7f13580c74f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.235 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 --2- 172.21.15.151:0/589226836 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f13580cb5c0 0x7f135814fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.235 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 -- 172.21.15.151:0/589226836 >> 172.21.15.151:0/589226836 conn(0x7f1358068e90 msgr2=0x7f13580bee30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:56.236 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 -- 172.21.15.151:0/589226836 shutdown_connections 2022-03-15T05:49:56.236 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.230+0000 7f135d15b700 1 -- 172.21.15.151:0/589226836 wait complete. 2022-03-15T05:49:56.257 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-03-15T05:49:46.741897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-03-15T05:49:54.617407+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-03-15T05:49:56.258 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-03-15T05:49:56.466 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.463+0000 7f3c19414700 1 Processor -- start 2022-03-15T05:49:56.467 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.464+0000 7f3c19414700 1 -- start start 2022-03-15T05:49:56.469 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.465+0000 7f3c19414700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3c14157a20 0x7f3c14155800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.469 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.465+0000 7f3c19414700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c140c5c70 con 0x7f3c140c2db0 2022-03-15T05:49:56.469 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.465+0000 7f3c19414700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c140c2920 con 0x7f3c14157df0 2022-03-15T05:49:56.470 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.465+0000 7f3c19414700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c14155d40 con 0x7f3c14157a20 2022-03-15T05:49:56.470 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.465+0000 7f3c12ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3c14157a20 0x7f3c14155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.470 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.465+0000 7f3c137fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f3c140c2db0 0x7f3c140c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53154/0 (socket says 172.21.15.151:53154) 2022-03-15T05:49:56.470 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.465+0000 7f3c137fe700 1 -- 172.21.15.151:0/51557405 learned_addr learned my addr 172.21.15.151:0/51557405 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:56.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.465+0000 7f3c12ffd700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3c14157a20 0x7f3c14155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59938/0 (socket says 172.21.15.151:59938) 2022-03-15T05:49:56.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.465+0000 7f3c127fc700 1 --1- 172.21.15.151:0/51557405 >> v1:172.21.15.164:6789/0 conn(0x7f3c14157df0 0x7f3c140cb050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33622/0 (socket says 172.21.15.151:33622) 2022-03-15T05:49:56.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.466+0000 7f3c12ffd700 1 -- 172.21.15.151:0/51557405 >> v1:172.21.15.164:6789/0 conn(0x7f3c14157df0 legacy=0x7f3c140cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.466+0000 7f3c12ffd700 1 -- 172.21.15.151:0/51557405 >> v1:172.21.15.151:6789/0 conn(0x7f3c140c2db0 legacy=0x7f3c140c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.472 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.466+0000 7f3c11ffb700 1 -- 172.21.15.151:0/51557405 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1740563686 0 0) 0x7f3c140c2920 con 0x7f3c14157df0 2022-03-15T05:49:56.472 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.466+0000 7f3c12ffd700 1 -- 172.21.15.151:0/51557405 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c140cb850 con 0x7f3c14157a20 2022-03-15T05:49:56.472 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.466+0000 7f3c12ffd700 1 --2- 172.21.15.151:0/51557405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 0x7f3c14155800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009760 tx=0x7f3c04009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eab9236a96aca03 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:56.472 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.466+0000 7f3c11ffb700 1 -- 172.21.15.151:0/51557405 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04004030 con 0x7f3c14157a20 2022-03-15T05:49:56.473 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.466+0000 7f3c11ffb700 1 -- 172.21.15.151:0/51557405 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c04004190 con 0x7f3c14157a20 2022-03-15T05:49:56.473 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.466+0000 7f3c11ffb700 1 -- 172.21.15.151:0/51557405 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c04011630 con 0x7f3c14157a20 2022-03-15T05:49:56.477 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.467+0000 7f3c19414700 1 -- 172.21.15.151:0/51557405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 msgr2=0x7f3c14155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.477 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.467+0000 7f3c19414700 1 --2- 172.21.15.151:0/51557405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 0x7f3c14155800 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f3c04009760 tx=0x7f3c04009060 comp rx=0 tx=0).stop 2022-03-15T05:49:56.477 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.467+0000 7f3c19414700 1 -- 172.21.15.151:0/51557405 shutdown_connections 2022-03-15T05:49:56.478 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.467+0000 7f3c19414700 1 --2- 172.21.15.151:0/51557405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 0x7f3c14155800 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.478 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.467+0000 7f3c19414700 1 -- 172.21.15.151:0/51557405 >> 172.21.15.151:0/51557405 conn(0x7f3c14068ec0 msgr2=0x7f3c140692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:56.478 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.467+0000 7f3c19414700 1 -- 172.21.15.151:0/51557405 shutdown_connections 2022-03-15T05:49:56.478 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.467+0000 7f3c19414700 1 -- 172.21.15.151:0/51557405 wait complete. 2022-03-15T05:49:56.479 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.469+0000 7f3c19414700 1 Processor -- start 2022-03-15T05:49:56.479 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.469+0000 7f3c19414700 1 -- start start 2022-03-15T05:49:56.479 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c19414700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c140c2db0 0x7f3c14168990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.479 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c19414700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 0x7f3c14150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.480 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c19414700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c14157df0 0x7f3c14154a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.480 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c19414700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1414fe80 con 0x7f3c14157a20 2022-03-15T05:49:56.480 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c19414700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c141651e0 con 0x7f3c140c2db0 2022-03-15T05:49:56.480 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c19414700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c140ca5f0 con 0x7f3c14157df0 2022-03-15T05:49:56.480 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c127fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 0x7f3c14150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.481 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c12ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c140c2db0 0x7f3c14168990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.481 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c137fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c14157df0 0x7f3c14154a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.481 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c127fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 0x7f3c14150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59942/0 (socket says 172.21.15.151:59942) 2022-03-15T05:49:56.481 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c127fc700 1 -- 172.21.15.151:0/226246369 learned_addr learned my addr 172.21.15.151:0/226246369 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:56.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c12ffd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c140c2db0 0x7f3c14168990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57166/0 (socket says 172.21.15.151:57166) 2022-03-15T05:49:56.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c127fc700 1 -- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c14157df0 msgr2=0x7f3c14154a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.470+0000 7f3c127fc700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c14157df0 0x7f3c14154a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.471+0000 7f3c127fc700 1 -- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c140c2db0 msgr2=0x7f3c14168990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.471+0000 7f3c127fc700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c140c2db0 0x7f3c14168990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.483 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.471+0000 7f3c127fc700 1 -- 172.21.15.151:0/226246369 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c040092a0 con 0x7f3c14157a20 2022-03-15T05:49:56.483 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.471+0000 7f3c12ffd700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c140c2db0 0x7f3c14168990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:56.483 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.471+0000 7f3c127fc700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 0x7f3c14150cf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c490 tx=0x7f3c08007c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:56.483 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.471+0000 7f3bfaffd700 1 -- 172.21.15.151:0/226246369 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0800ce40 con 0x7f3c14157a20 2022-03-15T05:49:56.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.471+0000 7f3bfaffd700 1 -- 172.21.15.151:0/226246369 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c08007360 con 0x7f3c14157a20 2022-03-15T05:49:56.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.471+0000 7f3bfaffd700 1 -- 172.21.15.151:0/226246369 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c080046b0 con 0x7f3c14157a20 2022-03-15T05:49:56.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.471+0000 7f3c19414700 1 -- 172.21.15.151:0/226246369 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c140ca8d0 con 0x7f3c14157a20 2022-03-15T05:49:56.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.471+0000 7f3c19414700 1 -- 172.21.15.151:0/226246369 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c14164b90 con 0x7f3c14157a20 2022-03-15T05:49:56.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.472+0000 7f3c19414700 1 -- 172.21.15.151:0/226246369 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1404b760 con 0x7f3c14157a20 2022-03-15T05:49:56.485 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.473+0000 7f3bfaffd700 1 -- 172.21.15.151:0/226246369 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f3c08010030 con 0x7f3c14157a20 2022-03-15T05:49:56.485 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.474+0000 7f3bfaffd700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3bf40633c0 0x7f3bf4065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.485 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.474+0000 7f3bfaffd700 1 -- 172.21.15.151:0/226246369 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f3c0807f330 con 0x7f3c14157a20 2022-03-15T05:49:56.485 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.474+0000 7f3c12ffd700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3bf40633c0 0x7f3bf4065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.486 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.475+0000 7f3c12ffd700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3bf40633c0 0x7f3bf4065870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3c04006f70 tx=0x7f3c04016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:56.486 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.478+0000 7f3bfaffd700 1 -- 172.21.15.151:0/226246369 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f3c0804e790 con 0x7f3c14157a20 2022-03-15T05:49:56.669 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.667+0000 7f3c19414700 1 -- 172.21.15.151:0/226246369 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3c140cbb30 con 0x7f3c14157a20 2022-03-15T05:49:56.670 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.667+0000 7f3bfaffd700 1 -- 172.21.15.151:0/226246369 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3c0807de60 con 0x7f3c14157a20 2022-03-15T05:49:56.671 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2022-03-15T05:49:56.673 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.669+0000 7f3c19414700 1 -- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3bf40633c0 msgr2=0x7f3bf4065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.673 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.669+0000 7f3c19414700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3bf40633c0 0x7f3bf4065870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3c04006f70 tx=0x7f3c04016000 comp rx=0 tx=0).stop 2022-03-15T05:49:56.673 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.670+0000 7f3c19414700 1 -- 172.21.15.151:0/226246369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 msgr2=0x7f3c14150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.674 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.670+0000 7f3c19414700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 0x7f3c14150cf0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c490 tx=0x7f3c08007c20 comp rx=0 tx=0).stop 2022-03-15T05:49:56.674 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.670+0000 7f3c19414700 1 -- 172.21.15.151:0/226246369 shutdown_connections 2022-03-15T05:49:56.674 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.670+0000 7f3c19414700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3bf40633c0 0x7f3bf4065870 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.674 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.670+0000 7f3c19414700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3c14157df0 0x7f3c14154a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.675 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.670+0000 7f3c19414700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3c140c2db0 0x7f3c14168990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.675 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.670+0000 7f3c19414700 1 --2- 172.21.15.151:0/226246369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c14157a20 0x7f3c14150cf0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.675 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.670+0000 7f3c19414700 1 -- 172.21.15.151:0/226246369 >> 172.21.15.151:0/226246369 conn(0x7f3c14068ec0 msgr2=0x7f3c14069290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:56.675 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.670+0000 7f3c19414700 1 -- 172.21.15.151:0/226246369 shutdown_connections 2022-03-15T05:49:56.676 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.670+0000 7f3c19414700 1 -- 172.21.15.151:0/226246369 wait complete. 2022-03-15T05:49:56.697 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-03-15T05:49:56.911 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.908+0000 7fc42c391700 1 Processor -- start 2022-03-15T05:49:56.912 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.909+0000 7fc42c391700 1 -- start start 2022-03-15T05:49:56.914 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.910+0000 7fc42c391700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc424155240 0x7fc424155610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.914 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.910+0000 7fc42c391700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 0x7fc4240c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.915 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.910+0000 7fc42c391700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4240ba8c0 con 0x7fc424155bc0 2022-03-15T05:49:56.915 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.910+0000 7fc42c391700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4240c3100 con 0x7fc424155240 2022-03-15T05:49:56.915 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.910+0000 7fc42c391700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4240c1840 con 0x7fc424152fb0 2022-03-15T05:49:56.915 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.910+0000 7fc42992c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 0x7fc4240c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.916 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.910+0000 7fc42a12d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fc424155240 0x7fc424155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.916 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.910+0000 7fc42a92e700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fc424155bc0 0x7fc4240ba1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33624/0 (socket says 172.21.15.151:33624) 2022-03-15T05:49:56.916 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.910+0000 7fc42a92e700 1 -- 172.21.15.151:0/2966428693 learned_addr learned my addr 172.21.15.151:0/2966428693 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:56.916 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.911+0000 7fc42912b700 1 -- 172.21.15.151:0/2966428693 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4130682552 0 0) 0x7fc4240ba8c0 con 0x7fc424155bc0 2022-03-15T05:49:56.917 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.911+0000 7fc42912b700 1 -- 172.21.15.151:0/2966428693 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc40c0033f0 con 0x7fc424155bc0 2022-03-15T05:49:56.917 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.911+0000 7fc42992c700 1 -- 172.21.15.151:0/2966428693 >> v2:172.21.15.164:3300/0 conn(0x7fc424155240 msgr2=0x7fc424155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:56.917 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.911+0000 7fc42992c700 1 --2- 172.21.15.151:0/2966428693 >> v2:172.21.15.164:3300/0 conn(0x7fc424155240 0x7fc424155610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.917 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.911+0000 7fc42992c700 1 -- 172.21.15.151:0/2966428693 >> v1:172.21.15.164:6789/0 conn(0x7fc424155bc0 legacy=0x7fc4240ba1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.911+0000 7fc42992c700 1 -- 172.21.15.151:0/2966428693 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4240c1b20 con 0x7fc424152fb0 2022-03-15T05:49:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.911+0000 7fc42992c700 1 --2- 172.21.15.151:0/2966428693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 0x7fc4240c2bc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc414009760 tx=0x7fc414009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e82d1e9b33b7ea18 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.911+0000 7fc42912b700 1 -- 172.21.15.151:0/2966428693 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4140105b0 con 0x7fc424152fb0 2022-03-15T05:49:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.911+0000 7fc42912b700 1 -- 172.21.15.151:0/2966428693 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc414010710 con 0x7fc424152fb0 2022-03-15T05:49:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.911+0000 7fc42912b700 1 -- 172.21.15.151:0/2966428693 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc414010ab0 con 0x7fc424152fb0 2022-03-15T05:49:56.922 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.912+0000 7fc42c391700 1 -- 172.21.15.151:0/2966428693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 msgr2=0x7fc4240c2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.912+0000 7fc42c391700 1 --2- 172.21.15.151:0/2966428693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 0x7fc4240c2bc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc414009760 tx=0x7fc414009060 comp rx=0 tx=0).stop 2022-03-15T05:49:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.912+0000 7fc42c391700 1 -- 172.21.15.151:0/2966428693 shutdown_connections 2022-03-15T05:49:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.912+0000 7fc42c391700 1 --2- 172.21.15.151:0/2966428693 >> v2:172.21.15.164:3300/0 conn(0x7fc424155240 0x7fc424155610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.912+0000 7fc42c391700 1 --2- 172.21.15.151:0/2966428693 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 0x7fc4240c2bc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.923 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.912+0000 7fc42c391700 1 -- 172.21.15.151:0/2966428693 >> 172.21.15.151:0/2966428693 conn(0x7fc42406aa60 msgr2=0x7fc4240c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:56.924 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.912+0000 7fc42c391700 1 -- 172.21.15.151:0/2966428693 shutdown_connections 2022-03-15T05:49:56.924 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.912+0000 7fc42c391700 1 -- 172.21.15.151:0/2966428693 wait complete. 2022-03-15T05:49:56.924 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.914+0000 7fc42c391700 1 Processor -- start 2022-03-15T05:49:56.924 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.914+0000 7fc42c391700 1 -- start start 2022-03-15T05:49:56.925 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42c391700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 0x7fc42414e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.925 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42c391700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc424155240 0x7fc4240c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.925 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42c391700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc424155bc0 0x7fc42414ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.925 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42c391700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42414c5b0 con 0x7fc424155240 2022-03-15T05:49:56.926 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42c391700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42414e600 con 0x7fc424155bc0 2022-03-15T05:49:56.926 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42c391700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc424164f80 con 0x7fc424152fb0 2022-03-15T05:49:56.926 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42992c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc424155240 0x7fc4240c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.926 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42a12d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 0x7fc42414e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.926 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42992c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc424155240 0x7fc4240c6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59944/0 (socket says 172.21.15.151:59944) 2022-03-15T05:49:56.927 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42992c700 1 -- 172.21.15.151:0/66996700 learned_addr learned my addr 172.21.15.151:0/66996700 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:56.927 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.915+0000 7fc42a92e700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc424155bc0 0x7fc42414ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.927 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc42a12d700 1 -- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc424155bc0 msgr2=0x7fc42414ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.927 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc42a12d700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc424155bc0 0x7fc42414ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.928 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc42a12d700 1 -- 172.21.15.151:0/66996700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc424155240 msgr2=0x7fc4240c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:56.928 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc42a12d700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc424155240 0x7fc4240c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:56.928 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc42a12d700 1 -- 172.21.15.151:0/66996700 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4140092a0 con 0x7fc424152fb0 2022-03-15T05:49:56.928 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc42a92e700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc424155bc0 0x7fc42414ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:49:56.928 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc42992c700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc424155240 0x7fc4240c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:56.929 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc42a12d700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 0x7fc42414e0c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc42000e930 tx=0x7fc420009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:56.929 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc4127fc700 1 -- 172.21.15.151:0/66996700 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420013680 con 0x7fc424152fb0 2022-03-15T05:49:56.929 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc4127fc700 1 -- 172.21.15.151:0/66996700 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4200137e0 con 0x7fc424152fb0 2022-03-15T05:49:56.929 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc4127fc700 1 -- 172.21.15.151:0/66996700 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc420013b80 con 0x7fc424152fb0 2022-03-15T05:49:56.930 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc42c391700 1 -- 172.21.15.151:0/66996700 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc424165220 con 0x7fc424152fb0 2022-03-15T05:49:56.930 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.916+0000 7fc42c391700 1 -- 172.21.15.151:0/66996700 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4241657c0 con 0x7fc424152fb0 2022-03-15T05:49:56.930 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.917+0000 7fc42c391700 1 -- 172.21.15.151:0/66996700 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42404b760 con 0x7fc424152fb0 2022-03-15T05:49:56.930 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.918+0000 7fc4127fc700 1 -- 172.21.15.151:0/66996700 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fc420023070 con 0x7fc424152fb0 2022-03-15T05:49:56.930 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.919+0000 7fc4127fc700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc4040633c0 0x7fc404065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:56.931 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.919+0000 7fc4127fc700 1 -- 172.21.15.151:0/66996700 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc42007fc70 con 0x7fc424152fb0 2022-03-15T05:49:56.931 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.919+0000 7fc42992c700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc4040633c0 0x7fc404065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:56.932 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.920+0000 7fc42992c700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc4040633c0 0x7fc404065870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc414010fd0 tx=0x7fc414016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:56.932 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:56.924+0000 7fc4127fc700 1 -- 172.21.15.151:0/66996700 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fc42004f050 con 0x7fc424152fb0 2022-03-15T05:49:57.113 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.110+0000 7fc42c391700 1 -- 172.21.15.151:0/66996700 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc4240c1e00 con 0x7fc424152fb0 2022-03-15T05:49:57.114 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.112+0000 7fc4127fc700 1 -- 172.21.15.151:0/66996700 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc4200210a0 con 0x7fc424152fb0 2022-03-15T05:49:57.115 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 8 2022-03-15T05:49:57.117 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.113+0000 7fc42c391700 1 -- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc4040633c0 msgr2=0x7fc404065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.117 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.113+0000 7fc42c391700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc4040633c0 0x7fc404065870 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc414010fd0 tx=0x7fc414016000 comp rx=0 tx=0).stop 2022-03-15T05:49:57.117 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.113+0000 7fc42c391700 1 -- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 msgr2=0x7fc42414e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.113+0000 7fc42c391700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 0x7fc42414e0c0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc42000e930 tx=0x7fc420009060 comp rx=0 tx=0).stop 2022-03-15T05:49:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.113+0000 7fc42c391700 1 -- 172.21.15.151:0/66996700 shutdown_connections 2022-03-15T05:49:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.113+0000 7fc42c391700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc4040633c0 0x7fc404065870 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.118 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.113+0000 7fc42c391700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc424155bc0 0x7fc42414ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.113+0000 7fc42c391700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc424152fb0 0x7fc42414e0c0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.113+0000 7fc42c391700 1 --2- 172.21.15.151:0/66996700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc424155240 0x7fc4240c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.113+0000 7fc42c391700 1 -- 172.21.15.151:0/66996700 >> 172.21.15.151:0/66996700 conn(0x7fc42406aa60 msgr2=0x7fc424149fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.114+0000 7fc42c391700 1 -- 172.21.15.151:0/66996700 shutdown_connections 2022-03-15T05:49:57.119 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.114+0000 7fc42c391700 1 -- 172.21.15.151:0/66996700 wait complete. 2022-03-15T05:49:57.141 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-03-15T05:49:57.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.344+0000 7f4a45229700 1 Processor -- start 2022-03-15T05:49:57.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.344+0000 7f4a45229700 1 -- start start 2022-03-15T05:49:57.350 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.345+0000 7f4a45229700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4a400c1800 0x7f4a40154a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.351 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.345+0000 7f4a45229700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a40154fb0 0x7f4a40155420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.351 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.345+0000 7f4a45229700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a400ad070 con 0x7f4a400acca0 2022-03-15T05:49:57.351 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.345+0000 7f4a45229700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a40154480 con 0x7f4a400c1800 2022-03-15T05:49:57.351 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.345+0000 7f4a45229700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a40153520 con 0x7f4a40154fb0 2022-03-15T05:49:57.352 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.345+0000 7f4a3f7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4a400c1800 0x7f4a40154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.352 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.346+0000 7f4a3f7fe700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4a400c1800 0x7f4a40154a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59946/0 (socket says 172.21.15.151:59946) 2022-03-15T05:49:57.352 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.346+0000 7f4a3f7fe700 1 -- 172.21.15.151:0/3312177708 learned_addr learned my addr 172.21.15.151:0/3312177708 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:57.352 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.346+0000 7f4a3ffff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f4a400acca0 0x7f4a40066980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33628/0 (socket says 172.21.15.151:33628) 2022-03-15T05:49:57.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.346+0000 7f4a44a28700 1 --2- 172.21.15.151:0/3312177708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a40154fb0 0x7f4a40155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.346+0000 7f4a3f7fe700 1 -- 172.21.15.151:0/3312177708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a40154fb0 msgr2=0x7f4a40155420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:57.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.346+0000 7f4a3f7fe700 1 --2- 172.21.15.151:0/3312177708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a40154fb0 0x7f4a40155420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.346+0000 7f4a3f7fe700 1 -- 172.21.15.151:0/3312177708 >> v1:172.21.15.164:6789/0 conn(0x7f4a400acca0 legacy=0x7f4a40066980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.346+0000 7f4a3effd700 1 -- 172.21.15.151:0/3312177708 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272516243 0 0) 0x7f4a400ad070 con 0x7f4a400acca0 2022-03-15T05:49:57.354 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.346+0000 7f4a3f7fe700 1 -- 172.21.15.151:0/3312177708 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40153800 con 0x7f4a400c1800 2022-03-15T05:49:57.354 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.346+0000 7f4a3f7fe700 1 --2- 172.21.15.151:0/3312177708 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 0x7f4a40154a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4a400ad200 tx=0x7f4a340090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a044268d336ffd57 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:57.354 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a3effd700 1 -- 172.21.15.151:0/3312177708 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34004030 con 0x7f4a400c1800 2022-03-15T05:49:57.354 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a3effd700 1 -- 172.21.15.151:0/3312177708 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a34004190 con 0x7f4a400c1800 2022-03-15T05:49:57.355 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a3effd700 1 -- 172.21.15.151:0/3312177708 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34011630 con 0x7f4a400c1800 2022-03-15T05:49:57.355 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a45229700 1 -- 172.21.15.151:0/3312177708 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 msgr2=0x7f4a40154a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.355 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a45229700 1 --2- 172.21.15.151:0/3312177708 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 0x7f4a40154a70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4a400ad200 tx=0x7f4a340090f0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.355 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a45229700 1 -- 172.21.15.151:0/3312177708 shutdown_connections 2022-03-15T05:49:57.355 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a45229700 1 --2- 172.21.15.151:0/3312177708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a40154fb0 0x7f4a40155420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.356 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a45229700 1 --2- 172.21.15.151:0/3312177708 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 0x7f4a40154a70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.356 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a45229700 1 -- 172.21.15.151:0/3312177708 >> 172.21.15.151:0/3312177708 conn(0x7f4a400c3570 msgr2=0x7f4a400c3970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:57.356 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a45229700 1 -- 172.21.15.151:0/3312177708 shutdown_connections 2022-03-15T05:49:57.356 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.347+0000 7f4a45229700 1 -- 172.21.15.151:0/3312177708 wait complete. 2022-03-15T05:49:57.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.349+0000 7f4a45229700 1 Processor -- start 2022-03-15T05:49:57.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.349+0000 7f4a45229700 1 -- start start 2022-03-15T05:49:57.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a45229700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a400acca0 0x7f4a4014a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a45229700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 0x7f4a400c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a45229700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a40154fb0 0x7f4a400c5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a45229700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a40149850 con 0x7f4a400c1800 2022-03-15T05:49:57.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a45229700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4014a0f0 con 0x7f4a400acca0 2022-03-15T05:49:57.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a45229700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a400bd1a0 con 0x7f4a40154fb0 2022-03-15T05:49:57.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a3f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 0x7f4a400c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a3f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 0x7f4a400c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59948/0 (socket says 172.21.15.151:59948) 2022-03-15T05:49:57.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a3f7fe700 1 -- 172.21.15.151:0/4099306066 learned_addr learned my addr 172.21.15.151:0/4099306066 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:57.362 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a3ffff700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a400acca0 0x7f4a4014a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.362 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a44a28700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a40154fb0 0x7f4a400c5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.362 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.350+0000 7f4a3f7fe700 1 -- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a40154fb0 msgr2=0x7f4a400c5810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.362 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a3f7fe700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a40154fb0 0x7f4a400c5810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.363 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a3f7fe700 1 -- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a400acca0 msgr2=0x7f4a4014a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.363 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a3f7fe700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a400acca0 0x7f4a4014a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.363 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a3f7fe700 1 -- 172.21.15.151:0/4099306066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a34009370 con 0x7f4a400c1800 2022-03-15T05:49:57.363 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a3ffff700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a400acca0 0x7f4a4014a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:49:57.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a3f7fe700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 0x7f4a400c52d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009130 tx=0x7f4a34016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:57.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a27fff700 1 -- 172.21.15.151:0/4099306066 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a340036f0 con 0x7f4a400c1800 2022-03-15T05:49:57.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a27fff700 1 -- 172.21.15.151:0/4099306066 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a34003850 con 0x7f4a400c1800 2022-03-15T05:49:57.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a45229700 1 -- 172.21.15.151:0/4099306066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a400bd440 con 0x7f4a400c1800 2022-03-15T05:49:57.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a27fff700 1 -- 172.21.15.151:0/4099306066 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34003c10 con 0x7f4a400c1800 2022-03-15T05:49:57.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.351+0000 7f4a45229700 1 -- 172.21.15.151:0/4099306066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a40149d80 con 0x7f4a400c1800 2022-03-15T05:49:57.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.352+0000 7f4a45229700 1 -- 172.21.15.151:0/4099306066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a4006b1a0 con 0x7f4a400c1800 2022-03-15T05:49:57.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.353+0000 7f4a27fff700 1 -- 172.21.15.151:0/4099306066 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f4a3402b020 con 0x7f4a400c1800 2022-03-15T05:49:57.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.354+0000 7f4a27fff700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4a200633f0 0x7f4a200658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.354+0000 7f4a27fff700 1 -- 172.21.15.151:0/4099306066 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4a340819c0 con 0x7f4a400c1800 2022-03-15T05:49:57.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.355+0000 7f4a3ffff700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4a200633f0 0x7f4a200658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.355+0000 7f4a3ffff700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4a200633f0 0x7f4a200658a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4a300011e0 tx=0x7f4a30007ad0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:57.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.359+0000 7f4a27fff700 1 -- 172.21.15.151:0/4099306066 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f4a34050da0 con 0x7f4a400c1800 2022-03-15T05:49:57.587 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.584+0000 7f4a45229700 1 -- 172.21.15.151:0/4099306066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a400bda10 con 0x7f4a400c1800 2022-03-15T05:49:57.588 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.585+0000 7f4a27fff700 1 -- 172.21.15.151:0/4099306066 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+5051 (secure 0 0 0) 0x7f4a340543c0 con 0x7f4a400c1800 2022-03-15T05:49:57.588 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:49:57.588 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1733346300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1733346300},{"type":"v1","addr":"172.21.15.164:6836","nonce":1733346300}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2036596705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6837","nonce":2036596705},{"type":"v1","addr":"172.21.15.164:6839","nonce":2036596705}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3829445475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3829445475},{"type":"v1","addr":"172.21.15.151:6834","nonce":3829445475}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/745076217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":745076217},{"type":"v1","addr":"172.21.15.151:6837","nonce":745076217}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6838/4178735378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":4178735378},{"type":"v1","addr":"172.21.15.164:6838","nonce":4178735378}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4312,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/3891906240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3891906240},{"type":"v1","addr":"172.21.15.151:6835","nonce":3891906240}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2022-03-15T05:49:57.590 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 -- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4a200633f0 msgr2=0x7f4a200658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.591 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4a200633f0 0x7f4a200658a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4a300011e0 tx=0x7f4a30007ad0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.591 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 -- 172.21.15.151:0/4099306066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 msgr2=0x7f4a400c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.591 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 0x7f4a400c52d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4a34009130 tx=0x7f4a34016000 comp rx=0 tx=0).stop 2022-03-15T05:49:57.591 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 -- 172.21.15.151:0/4099306066 shutdown_connections 2022-03-15T05:49:57.592 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4a200633f0 0x7f4a200658a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.592 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4a40154fb0 0x7f4a400c5810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.592 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a400acca0 0x7f4a4014a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.592 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 --2- 172.21.15.151:0/4099306066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a400c1800 0x7f4a400c52d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.592 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 -- 172.21.15.151:0/4099306066 >> 172.21.15.151:0/4099306066 conn(0x7f4a400c3570 msgr2=0x7f4a400680e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:57.593 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 -- 172.21.15.151:0/4099306066 shutdown_connections 2022-03-15T05:49:57.593 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.587+0000 7f4a45229700 1 -- 172.21.15.151:0/4099306066 wait complete. 2022-03-15T05:49:57.593 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 3 2022-03-15T05:49:57.614 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-15T05:49:57.823 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.820+0000 7f9dc7242700 1 Processor -- start 2022-03-15T05:49:57.823 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.820+0000 7f9dc7242700 1 -- start start 2022-03-15T05:49:57.826 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.822+0000 7f9dc7242700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9dc00cb5c0 0x7f9dc00c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.826 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.822+0000 7f9dc7242700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 0x7f9dc00c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.827 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.822+0000 7f9dc7242700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc00c27b0 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.827 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.822+0000 7f9dc7242700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc0156170 con 0x7f9dc00cb5c0 2022-03-15T05:49:57.827 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.822+0000 7f9dc7242700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00c4f90 con 0x7f9dc0155cf0 2022-03-15T05:49:57.827 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.822+0000 7f9dc4fde700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f9dc00cb1f0 0x7f9dc01566c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33630/0 (socket says 172.21.15.151:33630) 2022-03-15T05:49:57.828 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.822+0000 7f9dc4fde700 1 -- 172.21.15.151:0/310604542 learned_addr learned my addr 172.21.15.151:0/310604542 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:57.828 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.822+0000 7f9dbffff700 1 --2- 172.21.15.151:0/310604542 >> v2:172.21.15.151:3300/0 conn(0x7f9dc00cb5c0 0x7f9dc00c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.828 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.822+0000 7f9dc57df700 1 --2- 172.21.15.151:0/310604542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 0x7f9dc00c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.828 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.823+0000 7f9dbf7fe700 1 -- 172.21.15.151:0/310604542 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1743868461 0 0) 0x7f9dc00c27b0 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.828 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.823+0000 7f9dbf7fe700 1 -- 172.21.15.151:0/310604542 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9da40033f0 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.829 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.823+0000 7f9dbffff700 1 -- 172.21.15.151:0/310604542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 msgr2=0x7f9dc00c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:57.829 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.823+0000 7f9dbffff700 1 --2- 172.21.15.151:0/310604542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 0x7f9dc00c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.829 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.823+0000 7f9dbffff700 1 -- 172.21.15.151:0/310604542 >> v1:172.21.15.164:6789/0 conn(0x7f9dc00cb1f0 legacy=0x7f9dc01566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.829 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.823+0000 7f9dbffff700 1 -- 172.21.15.151:0/310604542 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00c5270 con 0x7f9dc00cb5c0 2022-03-15T05:49:57.830 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.823+0000 7f9dbffff700 1 --2- 172.21.15.151:0/310604542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb5c0 0x7f9dc00c34e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009760 tx=0x7f9dac009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f10333d8504834 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:57.833 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.824+0000 7f9dbf7fe700 1 -- 172.21.15.151:0/310604542 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac0105b0 con 0x7f9dc00cb5c0 2022-03-15T05:49:57.834 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.824+0000 7f9dbf7fe700 1 -- 172.21.15.151:0/310604542 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dac010710 con 0x7f9dc00cb5c0 2022-03-15T05:49:57.834 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.824+0000 7f9dbf7fe700 1 -- 172.21.15.151:0/310604542 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dac010ab0 con 0x7f9dc00cb5c0 2022-03-15T05:49:57.834 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.824+0000 7f9dc7242700 1 -- 172.21.15.151:0/310604542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb5c0 msgr2=0x7f9dc00c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.834 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.824+0000 7f9dc7242700 1 --2- 172.21.15.151:0/310604542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb5c0 0x7f9dc00c34e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9dac009760 tx=0x7f9dac009060 comp rx=0 tx=0).stop 2022-03-15T05:49:57.835 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.824+0000 7f9dc7242700 1 -- 172.21.15.151:0/310604542 shutdown_connections 2022-03-15T05:49:57.835 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.824+0000 7f9dc7242700 1 --2- 172.21.15.151:0/310604542 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 0x7f9dc00c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.835 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.824+0000 7f9dc7242700 1 --2- 172.21.15.151:0/310604542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb5c0 0x7f9dc00c34e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.835 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.824+0000 7f9dc7242700 1 -- 172.21.15.151:0/310604542 >> 172.21.15.151:0/310604542 conn(0x7f9dc0068e90 msgr2=0x7f9dc0069290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:57.836 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.825+0000 7f9dc7242700 1 -- 172.21.15.151:0/310604542 shutdown_connections 2022-03-15T05:49:57.836 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.825+0000 7f9dc7242700 1 -- 172.21.15.151:0/310604542 wait complete. 2022-03-15T05:49:57.836 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.826+0000 7f9dc7242700 1 Processor -- start 2022-03-15T05:49:57.836 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.826+0000 7f9dc7242700 1 -- start start 2022-03-15T05:49:57.836 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.827+0000 7f9dc7242700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb1f0 0x7f9dc01595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.837 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.827+0000 7f9dc7242700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dc00cb5c0 0x7f9dc0168cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.837 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.827+0000 7f9dc7242700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 0x7f9dc00bf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.837 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.827+0000 7f9dc7242700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc0165520 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.837 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.827+0000 7f9dc7242700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc01585f0 con 0x7f9dc00cb5c0 2022-03-15T05:49:57.838 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.827+0000 7f9dc7242700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc01588b0 con 0x7f9dc0155cf0 2022-03-15T05:49:57.838 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.827+0000 7f9dc4fde700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb1f0 0x7f9dc01595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.838 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.827+0000 7f9dc57df700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 0x7f9dc00bf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.838 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.827+0000 7f9dc4fde700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb1f0 0x7f9dc01595e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59952/0 (socket says 172.21.15.151:59952) 2022-03-15T05:49:57.839 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dc4fde700 1 -- 172.21.15.151:0/2695358535 learned_addr learned my addr 172.21.15.151:0/2695358535 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:57.839 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dbffff700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dc00cb5c0 0x7f9dc0168cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.839 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dc4fde700 1 -- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 msgr2=0x7f9dc00bf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.839 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dc4fde700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 0x7f9dc00bf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.840 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dc4fde700 1 -- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dc00cb5c0 msgr2=0x7f9dc0168cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:57.840 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dc4fde700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dc00cb5c0 0x7f9dc0168cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:57.840 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dc4fde700 1 -- 172.21.15.151:0/2695358535 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac0092a0 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.840 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dc57df700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 0x7f9dc00bf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:57.840 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dc4fde700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb1f0 0x7f9dc01595e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9db400c410 tx=0x7f9db4007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:57.841 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dbcff9700 1 -- 172.21.15.151:0/2695358535 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db40070d0 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.841 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dbcff9700 1 -- 172.21.15.151:0/2695358535 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db4007270 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.841 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.828+0000 7f9dc7242700 1 -- 172.21.15.151:0/2695358535 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc0158b90 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.841 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.829+0000 7f9dbcff9700 1 -- 172.21.15.151:0/2695358535 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db4007630 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.842 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.829+0000 7f9dc7242700 1 -- 172.21.15.151:0/2695358535 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc01651b0 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.842 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.830+0000 7f9dc7242700 1 -- 172.21.15.151:0/2695358535 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dc00700c0 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.842 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.831+0000 7f9dbcff9700 1 -- 172.21.15.151:0/2695358535 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f9db4019030 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.843 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.831+0000 7f9dbcff9700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9da80633c0 0x7f9da8065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:57.843 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.831+0000 7f9dbcff9700 1 -- 172.21.15.151:0/2695358535 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f9db407ea30 con 0x7f9dc00cb1f0 2022-03-15T05:49:57.844 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.832+0000 7f9dbffff700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9da80633c0 0x7f9da8065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:57.844 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.832+0000 7f9dbffff700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9da80633c0 0x7f9da8065870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00c9600 tx=0x7f9dac016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:57.844 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:57.836+0000 7f9dbcff9700 1 -- 172.21.15.151:0/2695358535 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f9db4048ac0 con 0x7f9dc00cb1f0 2022-03-15T05:49:58.025 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.022+0000 7f9dc7242700 1 -- 172.21.15.151:0/2695358535 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dc0088260 con 0x7f9dc00cb1f0 2022-03-15T05:49:58.026 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.023+0000 7f9dbcff9700 1 -- 172.21.15.151:0/2695358535 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13674 (secure 0 0 0) 0x7f9db4017070 con 0x7f9dc00cb1f0 2022-03-15T05:49:58.026 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:49:58.027 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":20,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:49:56.712724+0000","last_up_change":"2022-03-15T05:49:47.305366+0000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-03-15T05:49:46.741897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-03-15T05:49:54.617407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":35552},{"type":"v1","addr":"172.21.15.151:6801","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":35552},{"type":"v1","addr":"172.21.15.151:6803","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":35552},{"type":"v1","addr":"172.21.15.151:6807","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":35552},{"type":"v1","addr":"172.21.15.151:6805","nonce":35552}]},"public_addr":"172.21.15.151:6801/35552","cluster_addr":"172.21.15.151:6803/35552","heartbeat_back_addr":"172.21.15.151:6807/35552","heartbeat_front_addr":"172.21.15.151:6805/35552","state":["exists","up"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":35554},{"type":"v1","addr":"172.21.15.151:6821","nonce":35554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":35554},{"type":"v1","addr":"172.21.15.151:6825","nonce":35554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":35554},{"type":"v1","addr":"172.21.15.151:6831","nonce":35554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":35554},{"type":"v1","addr":"172.21.15.151:6829","nonce":35554}]},"public_addr":"172.21.15.151:6821/35554","cluster_addr":"172.21.15.151:6825/35554","heartbeat_back_addr":"172.21.15.151:6831/35554","heartbeat_front_addr":"172.21.15.151:6829/35554","state":["exists","up"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":35555},{"type":"v1","addr":"172.21.15.151:6817","nonce":35555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":35555},{"type":"v1","addr":"172.21.15.151:6820","nonce":35555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":35555},{"type":"v1","addr":"172.21.15.151:6828","nonce":35555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":35555},{"type":"v1","addr":"172.21.15.151:6824","nonce":35555}]},"public_addr":"172.21.15.151:6817/35555","cluster_addr":"172.21.15.151:6820/35555","heartbeat_back_addr":"172.21.15.151:6828/35555","heartbeat_front_addr":"172.21.15.151:6824/35555","state":["exists","up"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":35553},{"type":"v1","addr":"172.21.15.151:6809","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":35553},{"type":"v1","addr":"172.21.15.151:6811","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":35553},{"type":"v1","addr":"172.21.15.151:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":35553},{"type":"v1","addr":"172.21.15.151:6813","nonce":35553}]},"public_addr":"172.21.15.151:6809/35553","cluster_addr":"172.21.15.151:6811/35553","heartbeat_back_addr":"172.21.15.151:6815/35553","heartbeat_front_addr":"172.21.15.151:6813/35553","state":["exists","up"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":41130},{"type":"v1","addr":"172.21.15.164:6825","nonce":41130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":41130},{"type":"v1","addr":"172.21.15.164:6827","nonce":41130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":41130},{"type":"v1","addr":"172.21.15.164:6831","nonce":41130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":41130},{"type":"v1","addr":"172.21.15.164:6829","nonce":41130}]},"public_addr":"172.21.15.164:6825/41130","cluster_addr":"172.21.15.164:6827/41130","heartbeat_back_addr":"172.21.15.164:6831/41130","heartbeat_front_addr":"172.21.15.164:6829/41130","state":["exists","up"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":41119},{"type":"v1","addr":"172.21.15.164:6801","nonce":41119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":41119},{"type":"v1","addr":"172.21.15.164:6803","nonce":41119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":41119},{"type":"v1","addr":"172.21.15.164:6807","nonce":41119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":41119},{"type":"v1","addr":"172.21.15.164:6805","nonce":41119}]},"public_addr":"172.21.15.164:6801/41119","cluster_addr":"172.21.15.164:6803/41119","heartbeat_back_addr":"172.21.15.164:6807/41119","heartbeat_front_addr":"172.21.15.164:6805/41119","state":["exists","up"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":41129},{"type":"v1","addr":"172.21.15.164:6817","nonce":41129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":41129},{"type":"v1","addr":"172.21.15.164:6819","nonce":41129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":41129},{"type":"v1","addr":"172.21.15.164:6823","nonce":41129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":41129},{"type":"v1","addr":"172.21.15.164:6821","nonce":41129}]},"public_addr":"172.21.15.164:6817/41129","cluster_addr":"172.21.15.164:6819/41129","heartbeat_back_addr":"172.21.15.164:6823/41129","heartbeat_front_addr":"172.21.15.164:6821/41129","state":["exists","up"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":41120},{"type":"v1","addr":"172.21.15.164:6809","nonce":41120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":41120},{"type":"v1","addr":"172.21.15.164:6811","nonce":41120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":41120},{"type":"v1","addr":"172.21.15.164:6816","nonce":41120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":41120},{"type":"v1","addr":"172.21.15.164:6813","nonce":41120}]},"public_addr":"172.21.15.164:6809/41120","cluster_addr":"172.21.15.164:6811/41120","heartbeat_back_addr":"172.21.15.164:6816/41120","heartbeat_front_addr":"172.21.15.164:6813/41120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.378836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.466901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.764352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.688587+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.304917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.236409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.231122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.208581+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:49:58.030 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 -- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9da80633c0 msgr2=0x7f9da8065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.030 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9da80633c0 0x7f9da8065870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9dc00c9600 tx=0x7f9dac016000 comp rx=0 tx=0).stop 2022-03-15T05:49:58.030 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 -- 172.21.15.151:0/2695358535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb1f0 msgr2=0x7f9dc01595e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.030 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb1f0 0x7f9dc01595e0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9db400c410 tx=0x7f9db4007c70 comp rx=0 tx=0).stop 2022-03-15T05:49:58.031 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 -- 172.21.15.151:0/2695358535 shutdown_connections 2022-03-15T05:49:58.031 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9da80633c0 0x7f9da8065870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.031 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9dc0155cf0 0x7f9dc00bf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.031 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc00cb1f0 0x7f9dc01595e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.032 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 --2- 172.21.15.151:0/2695358535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9dc00cb5c0 0x7f9dc0168cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.032 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 -- 172.21.15.151:0/2695358535 >> 172.21.15.151:0/2695358535 conn(0x7f9dc0068e90 msgr2=0x7f9dc00c2500 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:58.032 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.025+0000 7f9dc7242700 1 -- 172.21.15.151:0/2695358535 shutdown_connections 2022-03-15T05:49:58.032 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.026+0000 7f9dc7242700 1 -- 172.21.15.151:0/2695358535 wait complete. 2022-03-15T05:49:58.053 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-03-15T05:49:46.741897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-03-15T05:49:54.617407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2022-03-15T05:49:58.053 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-03-15T05:49:58.262 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.259+0000 7fe17b59e700 1 Processor -- start 2022-03-15T05:49:58.263 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.260+0000 7fe17b59e700 1 -- start start 2022-03-15T05:49:58.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.261+0000 7fe17b59e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c0c7550 0x7fe17c1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.261+0000 7fe17b59e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c0c0700 con 0x7fe17c0bfb10 2022-03-15T05:49:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.261+0000 7fe17b59e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c153010 con 0x7fe17c06bad0 2022-03-15T05:49:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.261+0000 7fe17b59e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0beda0 con 0x7fe17c0c7550 2022-03-15T05:49:58.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.261+0000 7fe17a59c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe17c0bfb10 0x7fe17c155e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53156/0 (socket says 172.21.15.151:53156) 2022-03-15T05:49:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.261+0000 7fe17ad9d700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fe17c06bad0 0x7fe17c156550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33632/0 (socket says 172.21.15.151:33632) 2022-03-15T05:49:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.261+0000 7fe17a59c700 1 -- 172.21.15.151:0/4293109708 learned_addr learned my addr 172.21.15.151:0/4293109708 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.261+0000 7fe179d9b700 1 --2- 172.21.15.151:0/4293109708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c0c7550 0x7fe17c1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.262+0000 7fe17959a700 1 -- 172.21.15.151:0/4293109708 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754265451 0 0) 0x7fe17c153010 con 0x7fe17c06bad0 2022-03-15T05:49:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.262+0000 7fe17959a700 1 -- 172.21.15.151:0/4293109708 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1600033f0 con 0x7fe17c06bad0 2022-03-15T05:49:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.262+0000 7fe179d9b700 1 -- 172.21.15.151:0/4293109708 >> v1:172.21.15.164:6789/0 conn(0x7fe17c06bad0 legacy=0x7fe17c156550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.262+0000 7fe17959a700 1 -- 172.21.15.151:0/4293109708 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1591276129 0 0) 0x7fe17c0c0700 con 0x7fe17c0bfb10 2022-03-15T05:49:58.268 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.262+0000 7fe179d9b700 1 -- 172.21.15.151:0/4293109708 >> v1:172.21.15.151:6789/0 conn(0x7fe17c0bfb10 legacy=0x7fe17c155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.262+0000 7fe179d9b700 1 -- 172.21.15.151:0/4293109708 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c156c60 con 0x7fe17c0c7550 2022-03-15T05:49:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.262+0000 7fe179d9b700 1 --2- 172.21.15.151:0/4293109708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c0c7550 0x7fe17c1534a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe170009790 tx=0x7fe170009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cd40e4cb89e9d04 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.262+0000 7fe17959a700 1 -- 172.21.15.151:0/4293109708 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170011630 con 0x7fe17c0c7550 2022-03-15T05:49:58.269 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.262+0000 7fe17959a700 1 -- 172.21.15.151:0/4293109708 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170011790 con 0x7fe17c0c7550 2022-03-15T05:49:58.270 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.262+0000 7fe17959a700 1 -- 172.21.15.151:0/4293109708 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170011b10 con 0x7fe17c0c7550 2022-03-15T05:49:58.270 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.263+0000 7fe17b59e700 1 -- 172.21.15.151:0/4293109708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c0c7550 msgr2=0x7fe17c1534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.270 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.263+0000 7fe17b59e700 1 --2- 172.21.15.151:0/4293109708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c0c7550 0x7fe17c1534a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe170009790 tx=0x7fe170009060 comp rx=0 tx=0).stop 2022-03-15T05:49:58.274 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.263+0000 7fe17b59e700 1 -- 172.21.15.151:0/4293109708 shutdown_connections 2022-03-15T05:49:58.274 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.263+0000 7fe17b59e700 1 --2- 172.21.15.151:0/4293109708 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c0c7550 0x7fe17c1534a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.274 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.263+0000 7fe17b59e700 1 -- 172.21.15.151:0/4293109708 >> 172.21.15.151:0/4293109708 conn(0x7fe17c06a990 msgr2=0x7fe17c0c6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:58.275 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.263+0000 7fe17b59e700 1 -- 172.21.15.151:0/4293109708 shutdown_connections 2022-03-15T05:49:58.275 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.263+0000 7fe17b59e700 1 -- 172.21.15.151:0/4293109708 wait complete. 2022-03-15T05:49:58.275 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.265+0000 7fe17b59e700 1 Processor -- start 2022-03-15T05:49:58.275 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.265+0000 7fe17b59e700 1 -- start start 2022-03-15T05:49:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe17b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe17c06bad0 0x7fe17c151710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe17b59e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe17c0bfb10 0x7fe17c14d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe17b59e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c152510 0x7fe17c14d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.276 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe17b59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c155a10 con 0x7fe17c06bad0 2022-03-15T05:49:58.277 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe17b59e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c0c32f0 con 0x7fe17c0bfb10 2022-03-15T05:49:58.277 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe17b59e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c165830 con 0x7fe17c152510 2022-03-15T05:49:58.277 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe17a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe17c06bad0 0x7fe17c151710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.277 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe17a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe17c06bad0 0x7fe17c151710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59954/0 (socket says 172.21.15.151:59954) 2022-03-15T05:49:58.278 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe17a59c700 1 -- 172.21.15.151:0/2334577663 learned_addr learned my addr 172.21.15.151:0/2334577663 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:58.278 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe179d9b700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe17c0bfb10 0x7fe17c14d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.278 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.266+0000 7fe17ad9d700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c152510 0x7fe17c14d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.278 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe179d9b700 1 -- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c152510 msgr2=0x7fe17c14d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe179d9b700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c152510 0x7fe17c14d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe179d9b700 1 -- 172.21.15.151:0/2334577663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe17c06bad0 msgr2=0x7fe17c151710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe179d9b700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe17c06bad0 0x7fe17c151710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe179d9b700 1 -- 172.21.15.151:0/2334577663 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1700092a0 con 0x7fe17c0bfb10 2022-03-15T05:49:58.279 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe17a59c700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe17c06bad0 0x7fe17c151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:58.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe179d9b700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe17c0bfb10 0x7fe17c14d3b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe170016000 tx=0x7fe170017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:58.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe16a7fc700 1 -- 172.21.15.151:0/2334577663 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170011900 con 0x7fe17c0bfb10 2022-03-15T05:49:58.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe16a7fc700 1 -- 172.21.15.151:0/2334577663 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170011a80 con 0x7fe17c0bfb10 2022-03-15T05:49:58.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe17b59e700 1 -- 172.21.15.151:0/2334577663 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe17c165af0 con 0x7fe17c0bfb10 2022-03-15T05:49:58.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe16a7fc700 1 -- 172.21.15.151:0/2334577663 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17001a680 con 0x7fe17c0bfb10 2022-03-15T05:49:58.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.267+0000 7fe17b59e700 1 -- 172.21.15.151:0/2334577663 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c1550e0 con 0x7fe17c0bfb10 2022-03-15T05:49:58.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.268+0000 7fe17b59e700 1 -- 172.21.15.151:0/2334577663 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17c070480 con 0x7fe17c0bfb10 2022-03-15T05:49:58.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.269+0000 7fe16a7fc700 1 -- 172.21.15.151:0/2334577663 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fe17000f050 con 0x7fe17c0bfb10 2022-03-15T05:49:58.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.270+0000 7fe16a7fc700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe1580633c0 0x7fe158065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.270+0000 7fe16a7fc700 1 -- 172.21.15.151:0/2334577663 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fe1700811b0 con 0x7fe17c0bfb10 2022-03-15T05:49:58.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.270+0000 7fe17a59c700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe1580633c0 0x7fe158065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.271+0000 7fe17a59c700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe1580633c0 0x7fe158065870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0017a0 tx=0x7fe16c007c70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:58.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.275+0000 7fe16a7fc700 1 -- 172.21.15.151:0/2334577663 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fe170050640 con 0x7fe17c0bfb10 2022-03-15T05:49:58.467 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.464+0000 7fe17b59e700 1 -- 172.21.15.151:0/2334577663 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe17c155b50 con 0x7fe17c0bfb10 2022-03-15T05:49:58.467 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.464+0000 7fe16a7fc700 1 -- 172.21.15.151:0/2334577663 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe170053c60 con 0x7fe17c0bfb10 2022-03-15T05:49:58.468 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2022-03-15T05:49:58.470 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 -- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe1580633c0 msgr2=0x7fe158065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe1580633c0 0x7fe158065870 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0017a0 tx=0x7fe16c007c70 comp rx=0 tx=0).stop 2022-03-15T05:49:58.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 -- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe17c0bfb10 msgr2=0x7fe17c14d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe17c0bfb10 0x7fe17c14d3b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe170016000 tx=0x7fe170017000 comp rx=0 tx=0).stop 2022-03-15T05:49:58.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 -- 172.21.15.151:0/2334577663 shutdown_connections 2022-03-15T05:49:58.472 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe1580633c0 0x7fe158065870 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.472 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe17c152510 0x7fe17c14d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.472 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe17c06bad0 0x7fe17c151710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.472 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 --2- 172.21.15.151:0/2334577663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe17c0bfb10 0x7fe17c14d3b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.473 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 -- 172.21.15.151:0/2334577663 >> 172.21.15.151:0/2334577663 conn(0x7fe17c06a990 msgr2=0x7fe17c066980 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:58.473 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 -- 172.21.15.151:0/2334577663 shutdown_connections 2022-03-15T05:49:58.473 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.467+0000 7fe17b59e700 1 -- 172.21.15.151:0/2334577663 wait complete. 2022-03-15T05:49:58.495 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-03-15T05:49:58.706 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.703+0000 7f709c5c7700 1 Processor -- start 2022-03-15T05:49:58.707 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.703+0000 7f709c5c7700 1 -- start start 2022-03-15T05:49:58.708 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.704+0000 7f709c5c7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f709414cd00 0x7f70940c7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.709 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.704+0000 7f709c5c7700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f709414d0d0 0x7f7094153030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.709 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.704+0000 7f709c5c7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70940c7980 con 0x7f70940c0d40 2022-03-15T05:49:58.709 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.704+0000 7f709c5c7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7094152be0 con 0x7f709414cd00 2022-03-15T05:49:58.709 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.704+0000 7f709c5c7700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70940c0060 con 0x7f709414d0d0 2022-03-15T05:49:58.710 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.705+0000 7f709a363700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f709414cd00 0x7f70940c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.710 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.705+0000 7f7099b62700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f70940c0d40 0x7f709406e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53158/0 (socket says 172.21.15.151:53158) 2022-03-15T05:49:58.710 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.705+0000 7f709a363700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f709414cd00 0x7f70940c7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59956/0 (socket says 172.21.15.151:59956) 2022-03-15T05:49:58.710 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.705+0000 7f7099b62700 1 -- 172.21.15.151:0/3516838024 learned_addr learned my addr 172.21.15.151:0/3516838024 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:58.711 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.705+0000 7f709ab64700 1 --2- 172.21.15.151:0/3516838024 >> v2:172.21.15.164:3300/0 conn(0x7f709414d0d0 0x7f7094153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.711 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.705+0000 7f709a363700 1 -- 172.21.15.151:0/3516838024 >> v2:172.21.15.164:3300/0 conn(0x7f709414d0d0 msgr2=0x7f7094153030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:58.711 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.705+0000 7f709a363700 1 --2- 172.21.15.151:0/3516838024 >> v2:172.21.15.164:3300/0 conn(0x7f709414d0d0 0x7f7094153030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.711 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.705+0000 7f709a363700 1 -- 172.21.15.151:0/3516838024 >> v1:172.21.15.151:6789/0 conn(0x7f70940c0d40 legacy=0x7f709406e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.711 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.705+0000 7f709a363700 1 -- 172.21.15.151:0/3516838024 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70940c0340 con 0x7f709414cd00 2022-03-15T05:49:58.712 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.706+0000 7f709a363700 1 --2- 172.21.15.151:0/3516838024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 0x7f70940c7340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f70940ba2a0 tx=0x7f7090009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36173add05d6d5aa server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:58.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.706+0000 7f7099361700 1 -- 172.21.15.151:0/3516838024 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090011630 con 0x7f709414cd00 2022-03-15T05:49:58.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.706+0000 7f7099361700 1 -- 172.21.15.151:0/3516838024 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7090011790 con 0x7f709414cd00 2022-03-15T05:49:58.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.706+0000 7f7099361700 1 -- 172.21.15.151:0/3516838024 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7090011b50 con 0x7f709414cd00 2022-03-15T05:49:58.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.706+0000 7f709c5c7700 1 -- 172.21.15.151:0/3516838024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 msgr2=0x7f70940c7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.706+0000 7f709c5c7700 1 --2- 172.21.15.151:0/3516838024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 0x7f70940c7340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f70940ba2a0 tx=0x7f7090009060 comp rx=0 tx=0).stop 2022-03-15T05:49:58.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.707+0000 7f709c5c7700 1 -- 172.21.15.151:0/3516838024 shutdown_connections 2022-03-15T05:49:58.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.707+0000 7f709c5c7700 1 --2- 172.21.15.151:0/3516838024 >> v2:172.21.15.164:3300/0 conn(0x7f709414d0d0 0x7f7094153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.707+0000 7f709c5c7700 1 --2- 172.21.15.151:0/3516838024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 0x7f70940c7340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.707+0000 7f709c5c7700 1 -- 172.21.15.151:0/3516838024 >> 172.21.15.151:0/3516838024 conn(0x7f709406aa60 msgr2=0x7f70940c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:58.718 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.707+0000 7f709c5c7700 1 -- 172.21.15.151:0/3516838024 shutdown_connections 2022-03-15T05:49:58.718 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.707+0000 7f709c5c7700 1 -- 172.21.15.151:0/3516838024 wait complete. 2022-03-15T05:49:58.718 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.708+0000 7f709c5c7700 1 Processor -- start 2022-03-15T05:49:58.718 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.708+0000 7f709c5c7700 1 -- start start 2022-03-15T05:49:58.719 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.709+0000 7f709c5c7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70940c0d40 0x7f7094168d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.719 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.709+0000 7f709c5c7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 0x7f709406d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.719 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.709+0000 7f709c5c7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f709414d0d0 0x7f7094151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.719 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.709+0000 7f709c5c7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7094164db0 con 0x7f709414cd00 2022-03-15T05:49:58.720 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.709+0000 7f709c5c7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7094165d40 con 0x7f709414d0d0 2022-03-15T05:49:58.720 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.709+0000 7f709c5c7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70941658b0 con 0x7f70940c0d40 2022-03-15T05:49:58.720 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f7099b62700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 0x7f709406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.720 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f709ab64700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f709414d0d0 0x7f7094151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.720 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f7099b62700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 0x7f709406d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59958/0 (socket says 172.21.15.151:59958) 2022-03-15T05:49:58.721 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f7099b62700 1 -- 172.21.15.151:0/733329434 learned_addr learned my addr 172.21.15.151:0/733329434 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:58.721 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f709a363700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70940c0d40 0x7f7094168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.721 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f7099b62700 1 -- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70940c0d40 msgr2=0x7f7094168d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.721 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f7099b62700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70940c0d40 0x7f7094168d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.722 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f7099b62700 1 -- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f709414d0d0 msgr2=0x7f7094151290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.722 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f7099b62700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f709414d0d0 0x7f7094151290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.722 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f7099b62700 1 -- 172.21.15.151:0/733329434 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70900092a0 con 0x7f709414cd00 2022-03-15T05:49:58.722 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f709ab64700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f709414d0d0 0x7f7094151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:58.722 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.710+0000 7f7099b62700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 0x7f709406d790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f708400c490 tx=0x7f7084007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:58.723 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.711+0000 7f70827fc700 1 -- 172.21.15.151:0/733329434 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840070d0 con 0x7f709414cd00 2022-03-15T05:49:58.723 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.711+0000 7f70827fc700 1 -- 172.21.15.151:0/733329434 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7084007230 con 0x7f709414cd00 2022-03-15T05:49:58.723 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.711+0000 7f70827fc700 1 -- 172.21.15.151:0/733329434 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70840075b0 con 0x7f709414cd00 2022-03-15T05:49:58.723 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.711+0000 7f709c5c7700 1 -- 172.21.15.151:0/733329434 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7094164fa0 con 0x7f709414cd00 2022-03-15T05:49:58.724 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.711+0000 7f709c5c7700 1 -- 172.21.15.151:0/733329434 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7094165260 con 0x7f709414cd00 2022-03-15T05:49:58.724 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.712+0000 7f709c5c7700 1 -- 172.21.15.151:0/733329434 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709404b760 con 0x7f709414cd00 2022-03-15T05:49:58.724 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.713+0000 7f70827fc700 1 -- 172.21.15.151:0/733329434 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f7084019030 con 0x7f709414cd00 2022-03-15T05:49:58.725 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.713+0000 7f70827fc700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70740633f0 0x7f70740658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:58.725 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.713+0000 7f70827fc700 1 -- 172.21.15.151:0/733329434 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f708407ea60 con 0x7f709414cd00 2022-03-15T05:49:58.726 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.714+0000 7f709a363700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70740633f0 0x7f70740658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:58.726 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.714+0000 7f709a363700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70740633f0 0x7f70740658a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7090009270 tx=0x7f7090017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:58.726 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.717+0000 7f70827fc700 1 -- 172.21.15.151:0/733329434 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f708404de90 con 0x7f709414cd00 2022-03-15T05:49:58.914 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.911+0000 7f709c5c7700 1 -- 172.21.15.151:0/733329434 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f70941659f0 con 0x7f709414cd00 2022-03-15T05:49:58.915 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.912+0000 7f70827fc700 1 -- 172.21.15.151:0/733329434 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7084017070 con 0x7f709414cd00 2022-03-15T05:49:58.915 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 8 2022-03-15T05:49:58.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 -- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70740633f0 msgr2=0x7f70740658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70740633f0 0x7f70740658a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7090009270 tx=0x7f7090017000 comp rx=0 tx=0).stop 2022-03-15T05:49:58.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 -- 172.21.15.151:0/733329434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 msgr2=0x7f709406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:58.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 0x7f709406d790 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f708400c490 tx=0x7f7084007df0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 -- 172.21.15.151:0/733329434 shutdown_connections 2022-03-15T05:49:58.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f70740633f0 0x7f70740658a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f709414d0d0 0x7f7094151290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f70940c0d40 0x7f7094168d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.920 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 --2- 172.21.15.151:0/733329434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f709414cd00 0x7f709406d790 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:58.920 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 -- 172.21.15.151:0/733329434 >> 172.21.15.151:0/733329434 conn(0x7f709406aa60 msgr2=0x7f7094151e80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:58.920 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.914+0000 7f709c5c7700 1 -- 172.21.15.151:0/733329434 shutdown_connections 2022-03-15T05:49:58.920 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:58.915+0000 7f709c5c7700 1 -- 172.21.15.151:0/733329434 wait complete. 2022-03-15T05:49:58.943 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2022-03-15T05:49:59.148 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.145+0000 7fa2f2a7a700 1 Processor -- start 2022-03-15T05:49:59.149 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.145+0000 7fa2f2a7a700 1 -- start start 2022-03-15T05:49:59.152 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.146+0000 7fa2f2a7a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa2ec154d50 0x7fa2ec067a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.152 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.146+0000 7fa2f2a7a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2ec0c2860 0x7fa2ec155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.152 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.146+0000 7fa2f2a7a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2ec0c1cc0 con 0x7fa2ec155120 2022-03-15T05:49:59.152 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.146+0000 7fa2f2a7a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2ec0c33e0 con 0x7fa2ec154d50 2022-03-15T05:49:59.153 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.146+0000 7fa2f2a7a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec067fd0 con 0x7fa2ec0c2860 2022-03-15T05:49:59.153 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.147+0000 7fa2f0816700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa2ec154d50 0x7fa2ec067a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.153 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.147+0000 7fa2ebfff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa2ec155120 0x7fa2ec0c2150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53160/0 (socket says 172.21.15.151:53160) 2022-03-15T05:49:59.153 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.147+0000 7fa2ebfff700 1 -- 172.21.15.151:0/4060793799 learned_addr learned my addr 172.21.15.151:0/4060793799 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:59.154 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.147+0000 7fa2f1017700 1 --2- 172.21.15.151:0/4060793799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2ec0c2860 0x7fa2ec155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.154 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.147+0000 7fa2f0816700 1 -- 172.21.15.151:0/4060793799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2ec0c2860 msgr2=0x7fa2ec155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:49:59.154 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.147+0000 7fa2f0816700 1 --2- 172.21.15.151:0/4060793799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2ec0c2860 0x7fa2ec155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.155 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.147+0000 7fa2f0816700 1 -- 172.21.15.151:0/4060793799 >> v1:172.21.15.151:6789/0 conn(0x7fa2ec155120 legacy=0x7fa2ec0c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.155 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.147+0000 7fa2f0816700 1 -- 172.21.15.151:0/4060793799 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2ec0c4060 con 0x7fa2ec154d50 2022-03-15T05:49:59.155 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.147+0000 7fa2eb7fe700 1 -- 172.21.15.151:0/4060793799 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3326653245 0 0) 0x7fa2ec0c1cc0 con 0x7fa2ec155120 2022-03-15T05:49:59.156 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.148+0000 7fa2f0816700 1 --2- 172.21.15.151:0/4060793799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec154d50 0x7fa2ec067a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009760 tx=0x7fa2e0009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92953bcfbcc11c07 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:59.156 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.148+0000 7fa2eb7fe700 1 -- 172.21.15.151:0/4060793799 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0011630 con 0x7fa2ec154d50 2022-03-15T05:49:59.156 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.148+0000 7fa2eb7fe700 1 -- 172.21.15.151:0/4060793799 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0011790 con 0x7fa2ec154d50 2022-03-15T05:49:59.156 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.148+0000 7fa2eb7fe700 1 -- 172.21.15.151:0/4060793799 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0011b50 con 0x7fa2ec154d50 2022-03-15T05:49:59.156 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.148+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/4060793799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec154d50 msgr2=0x7fa2ec067a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.157 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.148+0000 7fa2f2a7a700 1 --2- 172.21.15.151:0/4060793799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec154d50 0x7fa2ec067a90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009760 tx=0x7fa2e0009060 comp rx=0 tx=0).stop 2022-03-15T05:49:59.157 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.148+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/4060793799 shutdown_connections 2022-03-15T05:49:59.157 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.148+0000 7fa2f2a7a700 1 --2- 172.21.15.151:0/4060793799 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2ec0c2860 0x7fa2ec155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.157 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.148+0000 7fa2f2a7a700 1 --2- 172.21.15.151:0/4060793799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec154d50 0x7fa2ec067a90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.158 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.148+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/4060793799 >> 172.21.15.151:0/4060793799 conn(0x7fa2ec0c75c0 msgr2=0x7fa2ec0c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:59.158 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.149+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/4060793799 shutdown_connections 2022-03-15T05:49:59.158 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.149+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/4060793799 wait complete. 2022-03-15T05:49:59.161 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.150+0000 7fa2f2a7a700 1 Processor -- start 2022-03-15T05:49:59.161 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.150+0000 7fa2f2a7a700 1 -- start start 2022-03-15T05:49:59.162 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.151+0000 7fa2f2a7a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec0c2860 0x7fa2ec146fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.162 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.151+0000 7fa2f2a7a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2ec154d50 0x7fa2ec1474e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.162 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.151+0000 7fa2f2a7a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2ec155120 0x7fa2ec06d250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.162 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.151+0000 7fa2f2a7a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec145ee0 con 0x7fa2ec0c2860 2022-03-15T05:49:59.163 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.151+0000 7fa2f2a7a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec06cdc0 con 0x7fa2ec154d50 2022-03-15T05:49:59.163 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.151+0000 7fa2f2a7a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec145a90 con 0x7fa2ec155120 2022-03-15T05:49:59.163 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.151+0000 7fa2f0816700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec0c2860 0x7fa2ec146fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.163 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2f0816700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec0c2860 0x7fa2ec146fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59962/0 (socket says 172.21.15.151:59962) 2022-03-15T05:49:59.164 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2f0816700 1 -- 172.21.15.151:0/1131526682 learned_addr learned my addr 172.21.15.151:0/1131526682 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:59.164 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2f1017700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2ec155120 0x7fa2ec06d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.164 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2ebfff700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2ec154d50 0x7fa2ec1474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.164 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2f0816700 1 -- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2ec155120 msgr2=0x7fa2ec06d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.165 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2f0816700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2ec155120 0x7fa2ec06d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.165 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2f0816700 1 -- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2ec154d50 msgr2=0x7fa2ec1474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.165 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2f0816700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2ec154d50 0x7fa2ec1474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.166 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2f0816700 1 -- 172.21.15.151:0/1131526682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e00092a0 con 0x7fa2ec0c2860 2022-03-15T05:49:59.166 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2ebfff700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2ec154d50 0x7fa2ec1474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:49:59.166 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2f0816700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec0c2860 0x7fa2ec146fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0011fc0 tx=0x7fa2e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:59.166 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.152+0000 7fa2e8ff9700 1 -- 172.21.15.151:0/1131526682 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0000bc0 con 0x7fa2ec0c2860 2022-03-15T05:49:59.167 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.153+0000 7fa2e8ff9700 1 -- 172.21.15.151:0/1131526682 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e0011900 con 0x7fa2ec0c2860 2022-03-15T05:49:59.167 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.153+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/1131526682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ec146130 con 0x7fa2ec0c2860 2022-03-15T05:49:59.167 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.153+0000 7fa2e8ff9700 1 -- 172.21.15.151:0/1131526682 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0025420 con 0x7fa2ec0c2860 2022-03-15T05:49:59.167 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.153+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/1131526682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec06ca50 con 0x7fa2ec0c2860 2022-03-15T05:49:59.168 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.154+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/1131526682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec06d0a0 con 0x7fa2ec0c2860 2022-03-15T05:49:59.168 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.154+0000 7fa2e8ff9700 1 -- 172.21.15.151:0/1131526682 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fa2e002c030 con 0x7fa2ec0c2860 2022-03-15T05:49:59.168 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.155+0000 7fa2e8ff9700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fa2d40633c0 0x7fa2d4065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.168 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.156+0000 7fa2e8ff9700 1 -- 172.21.15.151:0/1131526682 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa2e0080e90 con 0x7fa2ec0c2860 2022-03-15T05:49:59.169 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.156+0000 7fa2ebfff700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fa2d40633c0 0x7fa2d4065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.169 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.156+0000 7fa2ebfff700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fa2d40633c0 0x7fa2d4065870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0c0390 tx=0x7fa2d8007bf0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:59.169 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.160+0000 7fa2e8ff9700 1 -- 172.21.15.151:0/1131526682 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fa2e00502c0 con 0x7fa2ec0c2860 2022-03-15T05:49:59.352 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.349+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/1131526682 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa2ec04b760 con 0x7fa2ec0c2860 2022-03-15T05:49:59.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.349+0000 7fa2e8ff9700 1 -- 172.21.15.151:0/1131526682 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa2e002a090 con 0x7fa2ec0c2860 2022-03-15T05:49:59.353 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:49:59.353 INFO:teuthology.orchestra.run.smithi151.stdout:[ 2022-03-15T05:49:59.354 INFO:teuthology.orchestra.run.smithi151.stdout: { 2022-03-15T05:49:59.354 INFO:teuthology.orchestra.run.smithi151.stdout: "poolnum": 1, 2022-03-15T05:49:59.354 INFO:teuthology.orchestra.run.smithi151.stdout: "poolname": ".mgr" 2022-03-15T05:49:59.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2022-03-15T05:49:59.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2022-03-15T05:49:59.355 INFO:teuthology.orchestra.run.smithi151.stdout: "poolnum": 2, 2022-03-15T05:49:59.355 INFO:teuthology.orchestra.run.smithi151.stdout: "poolname": "rbd" 2022-03-15T05:49:59.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2022-03-15T05:49:59.356 INFO:teuthology.orchestra.run.smithi151.stdout:] 2022-03-15T05:49:59.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fa2d40633c0 msgr2=0x7fa2d4065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fa2d40633c0 0x7fa2d4065870 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec0c0390 tx=0x7fa2d8007bf0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/1131526682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec0c2860 msgr2=0x7fa2ec146fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec0c2860 0x7fa2ec146fa0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0011fc0 tx=0x7fa2e0017000 comp rx=0 tx=0).stop 2022-03-15T05:49:59.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/1131526682 shutdown_connections 2022-03-15T05:49:59.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fa2d40633c0 0x7fa2d4065870 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fa2ec155120 0x7fa2ec06d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec0c2860 0x7fa2ec146fa0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 --2- 172.21.15.151:0/1131526682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa2ec154d50 0x7fa2ec1474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/1131526682 >> 172.21.15.151:0/1131526682 conn(0x7fa2ec0c75c0 msgr2=0x7fa2ec0bec80 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:59.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/1131526682 shutdown_connections 2022-03-15T05:49:59.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.352+0000 7fa2f2a7a700 1 -- 172.21.15.151:0/1131526682 wait complete. 2022-03-15T05:49:59.379 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2022-03-15T05:49:59.379 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2022-03-15T05:49:59.591 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.588+0000 7f7738a7a700 1 Processor -- start 2022-03-15T05:49:59.592 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.588+0000 7f7738a7a700 1 -- start start 2022-03-15T05:49:59.595 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.589+0000 7f7738a7a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f7734157590 0x7f7734157960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.596 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.589+0000 7f7738a7a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7734155ec0 con 0x7f77340c5a70 2022-03-15T05:49:59.596 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.589+0000 7f7738a7a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7734067930 con 0x7f7734157fc0 2022-03-15T05:49:59.596 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.589+0000 7f7738a7a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7734158520 con 0x7f7734157590 2022-03-15T05:49:59.596 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.590+0000 7f7731d9b700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f7734157fc0 0x7f7734067dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33634/0 (socket says 172.21.15.151:33634) 2022-03-15T05:49:59.597 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.590+0000 7f7731d9b700 1 -- 172.21.15.151:0/3385817182 learned_addr learned my addr 172.21.15.151:0/3385817182 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:49:59.597 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.590+0000 7f773259c700 1 --2- 172.21.15.151:0/3385817182 >> v2:172.21.15.164:3300/0 conn(0x7f7734157590 0x7f7734157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.597 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.590+0000 7f773159a700 1 -- 172.21.15.151:0/3385817182 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480390334 0 0) 0x7f7734067930 con 0x7f7734157fc0 2022-03-15T05:49:59.598 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.590+0000 7f773159a700 1 -- 172.21.15.151:0/3385817182 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77180033f0 con 0x7f7734157fc0 2022-03-15T05:49:59.598 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.590+0000 7f773259c700 1 -- 172.21.15.151:0/3385817182 >> v1:172.21.15.164:6789/0 conn(0x7f7734157fc0 legacy=0x7f7734067dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.598 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.590+0000 7f773159a700 1 -- 172.21.15.151:0/3385817182 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1080743944 0 0) 0x7f7734155ec0 con 0x7f77340c5a70 2022-03-15T05:49:59.598 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.590+0000 7f773259c700 1 -- 172.21.15.151:0/3385817182 >> v1:172.21.15.151:6789/0 conn(0x7f77340c5a70 legacy=0x7f77340c49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.599 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.590+0000 7f773259c700 1 -- 172.21.15.151:0/3385817182 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7734158800 con 0x7f7734157590 2022-03-15T05:49:59.599 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.591+0000 7f773259c700 1 --2- 172.21.15.151:0/3385817182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7734157590 0x7f7734157960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7724009760 tx=0x7f7724009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4e82e71fae4794c server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:59.599 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.591+0000 7f773159a700 1 -- 172.21.15.151:0/3385817182 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724011630 con 0x7f7734157590 2022-03-15T05:49:59.600 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.591+0000 7f773159a700 1 -- 172.21.15.151:0/3385817182 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7724011790 con 0x7f7734157590 2022-03-15T05:49:59.600 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.591+0000 7f773159a700 1 -- 172.21.15.151:0/3385817182 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724011b30 con 0x7f7734157590 2022-03-15T05:49:59.600 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.591+0000 7f7738a7a700 1 -- 172.21.15.151:0/3385817182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7734157590 msgr2=0x7f7734157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.601 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.591+0000 7f7738a7a700 1 --2- 172.21.15.151:0/3385817182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7734157590 0x7f7734157960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7724009760 tx=0x7f7724009060 comp rx=0 tx=0).stop 2022-03-15T05:49:59.601 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.592+0000 7f7738a7a700 1 -- 172.21.15.151:0/3385817182 shutdown_connections 2022-03-15T05:49:59.601 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.592+0000 7f7738a7a700 1 --2- 172.21.15.151:0/3385817182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7734157590 0x7f7734157960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.601 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.592+0000 7f7738a7a700 1 -- 172.21.15.151:0/3385817182 >> 172.21.15.151:0/3385817182 conn(0x7f7734062490 msgr2=0x7f7734062890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:49:59.601 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.592+0000 7f7738a7a700 1 -- 172.21.15.151:0/3385817182 shutdown_connections 2022-03-15T05:49:59.602 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.592+0000 7f7738a7a700 1 -- 172.21.15.151:0/3385817182 wait complete. 2022-03-15T05:49:59.605 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.593+0000 7f7738a7a700 1 Processor -- start 2022-03-15T05:49:59.605 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.593+0000 7f7738a7a700 1 -- start start 2022-03-15T05:49:59.606 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.594+0000 7f7738a7a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77340c5a70 0x7f7734150650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.606 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.594+0000 7f7738a7a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7734157590 0x7f77340c1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.606 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.594+0000 7f7738a7a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7734157fc0 0x7f77340c72d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.606 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.594+0000 7f7738a7a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7734165320 con 0x7f7734157fc0 2022-03-15T05:49:59.607 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.594+0000 7f7738a7a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77340c99d0 con 0x7f77340c5a70 2022-03-15T05:49:59.607 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.594+0000 7f7738a7a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7734164730 con 0x7f7734157590 2022-03-15T05:49:59.607 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f7732d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7734157fc0 0x7f77340c72d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.608 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f773259c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77340c5a70 0x7f7734150650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.608 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f7732d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7734157fc0 0x7f77340c72d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59964/0 (socket says 172.21.15.151:59964) 2022-03-15T05:49:59.609 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f7731d9b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7734157590 0x7f77340c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.609 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f7732d9d700 1 -- 172.21.15.151:0/2930262116 learned_addr learned my addr 172.21.15.151:0/2930262116 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:49:59.609 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f773259c700 1 -- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7734157590 msgr2=0x7f77340c1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.609 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f773259c700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7734157590 0x7f77340c1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.610 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f773259c700 1 -- 172.21.15.151:0/2930262116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7734157fc0 msgr2=0x7f77340c72d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:49:59.610 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f773259c700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7734157fc0 0x7f77340c72d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:49:59.610 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f773259c700 1 -- 172.21.15.151:0/2930262116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77240092a0 con 0x7f77340c5a70 2022-03-15T05:49:59.610 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f7732d9d700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7734157fc0 0x7f77340c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:59.611 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.595+0000 7f7731d9b700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7734157590 0x7f77340c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:49:59.611 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.596+0000 7f773259c700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77340c5a70 0x7f7734150650 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7724016000 tx=0x7f7724017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:59.611 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.596+0000 7f77227fc700 1 -- 172.21.15.151:0/2930262116 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724000bc0 con 0x7f77340c5a70 2022-03-15T05:49:59.611 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.596+0000 7f77227fc700 1 -- 172.21.15.151:0/2930262116 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7724011900 con 0x7f77340c5a70 2022-03-15T05:49:59.612 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.596+0000 7f7738a7a700 1 -- 172.21.15.151:0/2930262116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77340c1c70 con 0x7f77340c5a70 2022-03-15T05:49:59.612 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.596+0000 7f77227fc700 1 -- 172.21.15.151:0/2930262116 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724025420 con 0x7f77340c5a70 2022-03-15T05:49:59.612 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.596+0000 7f7738a7a700 1 -- 172.21.15.151:0/2930262116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7734164cd0 con 0x7f77340c5a70 2022-03-15T05:49:59.612 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.597+0000 7f7738a7a700 1 -- 172.21.15.151:0/2930262116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7734165690 con 0x7f77340c5a70 2022-03-15T05:49:59.613 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.598+0000 7f77227fc700 1 -- 172.21.15.151:0/2930262116 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f772402c030 con 0x7f77340c5a70 2022-03-15T05:49:59.613 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.599+0000 7f77227fc700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77100633c0 0x7f7710065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:49:59.613 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.599+0000 7f77227fc700 1 -- 172.21.15.151:0/2930262116 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7724080db0 con 0x7f77340c5a70 2022-03-15T05:49:59.613 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.599+0000 7f7731d9b700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77100633c0 0x7f7710065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:49:59.614 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.600+0000 7f7731d9b700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77100633c0 0x7f7710065870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7734162350 tx=0x7f7728009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:49:59.614 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.604+0000 7f77227fc700 1 -- 172.21.15.151:0/2930262116 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f7724085070 con 0x7f77340c5a70 2022-03-15T05:49:59.792 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:49:59.789+0000 7f7738a7a700 1 -- 172.21.15.151:0/2930262116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f773404b760 con 0x7f77340c5a70 2022-03-15T05:50:00.741 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.738+0000 7f77227fc700 1 -- 172.21.15.151:0/2930262116 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7f77240150b0 con 0x7f77340c5a70 2022-03-15T05:50:00.749 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.744+0000 7f7738a7a700 1 -- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77100633c0 msgr2=0x7f7710065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:00.749 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.744+0000 7f7738a7a700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77100633c0 0x7f7710065870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7734162350 tx=0x7f7728009040 comp rx=0 tx=0).stop 2022-03-15T05:50:00.750 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.744+0000 7f7738a7a700 1 -- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77340c5a70 msgr2=0x7f7734150650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:00.750 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.744+0000 7f7738a7a700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77340c5a70 0x7f7734150650 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7724016000 tx=0x7f7724017000 comp rx=0 tx=0).stop 2022-03-15T05:50:00.750 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.746+0000 7f7738a7a700 1 -- 172.21.15.151:0/2930262116 shutdown_connections 2022-03-15T05:50:00.751 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.746+0000 7f7738a7a700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77100633c0 0x7f7710065870 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:00.751 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.746+0000 7f7738a7a700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7734157fc0 0x7f77340c72d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:00.751 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.746+0000 7f7738a7a700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f77340c5a70 0x7f7734150650 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:00.751 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.746+0000 7f7738a7a700 1 --2- 172.21.15.151:0/2930262116 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7734157590 0x7f77340c1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:00.751 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.746+0000 7f7738a7a700 1 -- 172.21.15.151:0/2930262116 >> 172.21.15.151:0/2930262116 conn(0x7f7734062490 msgr2=0x7f773414e880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:00.752 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.748+0000 7f7738a7a700 1 -- 172.21.15.151:0/2930262116 shutdown_connections 2022-03-15T05:50:00.752 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.748+0000 7f7738a7a700 1 -- 172.21.15.151:0/2930262116 wait complete. 2022-03-15T05:50:00.753 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'cephfs_metadata' created 2022-03-15T05:50:00.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2022-03-15T05:50:00.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.992+0000 7f2e84b27700 1 Processor -- start 2022-03-15T05:50:00.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.992+0000 7f2e84b27700 1 -- start start 2022-03-15T05:50:00.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.993+0000 7f2e84b27700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2e80157df0 0x7f2e80155800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:00.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.993+0000 7f2e84b27700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e800c2db0 0x7f2e800c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:00.999 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.994+0000 7f2e84b27700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e800c5c70 con 0x7f2e80157a20 2022-03-15T05:50:00.999 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.994+0000 7f2e84b27700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e800c2920 con 0x7f2e80157df0 2022-03-15T05:50:00.999 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.994+0000 7f2e84b27700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e80155d40 con 0x7f2e800c2db0 2022-03-15T05:50:00.999 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.994+0000 7f2e7dd9b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2e80157df0 0x7f2e80155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:01.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.994+0000 7f2e7e59c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f2e80157a20 0x7f2e800cb050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53164/0 (socket says 172.21.15.151:53164) 2022-03-15T05:50:01.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.994+0000 7f2e7e59c700 1 -- 172.21.15.151:0/3563476408 learned_addr learned my addr 172.21.15.151:0/3563476408 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:01.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.994+0000 7f2e7ed9d700 1 --2- 172.21.15.151:0/3563476408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e800c2db0 0x7f2e800c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:01.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.994+0000 7f2e7d59a700 1 -- 172.21.15.151:0/3563476408 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2769663892 0 0) 0x7f2e800c5c70 con 0x7f2e80157a20 2022-03-15T05:50:01.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.994+0000 7f2e7d59a700 1 -- 172.21.15.151:0/3563476408 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e640033f0 con 0x7f2e80157a20 2022-03-15T05:50:01.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.995+0000 7f2e7ed9d700 1 -- 172.21.15.151:0/3563476408 >> v2:172.21.15.151:3300/0 conn(0x7f2e80157df0 msgr2=0x7f2e80155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:01.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.995+0000 7f2e7ed9d700 1 --2- 172.21.15.151:0/3563476408 >> v2:172.21.15.151:3300/0 conn(0x7f2e80157df0 0x7f2e80155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:01.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.995+0000 7f2e7ed9d700 1 -- 172.21.15.151:0/3563476408 >> v1:172.21.15.151:6789/0 conn(0x7f2e80157a20 legacy=0x7f2e800cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:01.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.995+0000 7f2e7ed9d700 1 -- 172.21.15.151:0/3563476408 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e800cb850 con 0x7f2e800c2db0 2022-03-15T05:50:01.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.995+0000 7f2e7ed9d700 1 --2- 172.21.15.151:0/3563476408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e800c2db0 0x7f2e800c4b10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009e60 tx=0x7f2e78009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc2b2350778d34f9 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:01.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.995+0000 7f2e7d59a700 1 -- 172.21.15.151:0/3563476408 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800e070 con 0x7f2e800c2db0 2022-03-15T05:50:01.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.995+0000 7f2e7d59a700 1 -- 172.21.15.151:0/3563476408 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7800bab0 con 0x7f2e800c2db0 2022-03-15T05:50:01.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.995+0000 7f2e7d59a700 1 -- 172.21.15.151:0/3563476408 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800be50 con 0x7f2e800c2db0 2022-03-15T05:50:01.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.996+0000 7f2e84b27700 1 -- 172.21.15.151:0/3563476408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e800c2db0 msgr2=0x7f2e800c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:01.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.996+0000 7f2e84b27700 1 --2- 172.21.15.151:0/3563476408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e800c2db0 0x7f2e800c4b10 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2e78009e60 tx=0x7f2e78009780 comp rx=0 tx=0).stop 2022-03-15T05:50:01.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.996+0000 7f2e84b27700 1 -- 172.21.15.151:0/3563476408 shutdown_connections 2022-03-15T05:50:01.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.996+0000 7f2e84b27700 1 --2- 172.21.15.151:0/3563476408 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e800c2db0 0x7f2e800c4b10 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:01.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.996+0000 7f2e84b27700 1 --2- 172.21.15.151:0/3563476408 >> v2:172.21.15.151:3300/0 conn(0x7f2e80157df0 0x7f2e80155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:01.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.996+0000 7f2e84b27700 1 -- 172.21.15.151:0/3563476408 >> 172.21.15.151:0/3563476408 conn(0x7f2e80068ec0 msgr2=0x7f2e800692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:01.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.996+0000 7f2e84b27700 1 -- 172.21.15.151:0/3563476408 shutdown_connections 2022-03-15T05:50:01.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.996+0000 7f2e84b27700 1 -- 172.21.15.151:0/3563476408 wait complete. 2022-03-15T05:50:01.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.997+0000 7f2e84b27700 1 Processor -- start 2022-03-15T05:50:01.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.998+0000 7f2e84b27700 1 -- start start 2022-03-15T05:50:01.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e84b27700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e800c2db0 0x7f2e8014d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:01.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e84b27700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e80157a20 0x7f2e80151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:01.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e84b27700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e80157df0 0x7f2e80158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:01.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e84b27700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800b0ea0 con 0x7f2e80157a20 2022-03-15T05:50:01.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e84b27700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800bf280 con 0x7f2e800c2db0 2022-03-15T05:50:01.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e84b27700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e800b05b0 con 0x7f2e80157df0 2022-03-15T05:50:01.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e7dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e80157a20 0x7f2e80151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:01.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e7dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e80157a20 0x7f2e80151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59968/0 (socket says 172.21.15.151:59968) 2022-03-15T05:50:01.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e7dd9b700 1 -- 172.21.15.151:0/2339857686 learned_addr learned my addr 172.21.15.151:0/2339857686 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:01.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e7e59c700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e800c2db0 0x7f2e8014d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:01.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e7ed9d700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e80157df0 0x7f2e80158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:01.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e7dd9b700 1 -- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e80157df0 msgr2=0x7f2e80158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:01.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e7dd9b700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e80157df0 0x7f2e80158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:01.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e7dd9b700 1 -- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e800c2db0 msgr2=0x7f2e8014d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:01.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e7dd9b700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e800c2db0 0x7f2e8014d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:01.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:00.999+0000 7f2e7dd9b700 1 -- 172.21.15.151:0/2339857686 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e78009a20 con 0x7f2e80157a20 2022-03-15T05:50:01.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.000+0000 7f2e7dd9b700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e80157a20 0x7f2e80151ed0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400e900 tx=0x7f2e74009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:01.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.000+0000 7f2e6e7fc700 1 -- 172.21.15.151:0/2339857686 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74013680 con 0x7f2e80157a20 2022-03-15T05:50:01.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.000+0000 7f2e6e7fc700 1 -- 172.21.15.151:0/2339857686 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e740137e0 con 0x7f2e80157a20 2022-03-15T05:50:01.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.000+0000 7f2e84b27700 1 -- 172.21.15.151:0/2339857686 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e800bf520 con 0x7f2e80157a20 2022-03-15T05:50:01.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.000+0000 7f2e6e7fc700 1 -- 172.21.15.151:0/2339857686 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e74013b80 con 0x7f2e80157a20 2022-03-15T05:50:01.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.000+0000 7f2e84b27700 1 -- 172.21.15.151:0/2339857686 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e800b0b30 con 0x7f2e80157a20 2022-03-15T05:50:01.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.001+0000 7f2e84b27700 1 -- 172.21.15.151:0/2339857686 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e801590b0 con 0x7f2e80157a20 2022-03-15T05:50:01.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.002+0000 7f2e6e7fc700 1 -- 172.21.15.151:0/2339857686 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f2e74019030 con 0x7f2e80157a20 2022-03-15T05:50:01.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.003+0000 7f2e6e7fc700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2e5c0633c0 0x7f2e5c065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:01.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.003+0000 7f2e6e7fc700 1 -- 172.21.15.151:0/2339857686 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f2e7407f970 con 0x7f2e80157a20 2022-03-15T05:50:01.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.003+0000 7f2e7e59c700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2e5c0633c0 0x7f2e5c065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:01.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.004+0000 7f2e7e59c700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2e5c0633c0 0x7f2e5c065870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2e70005750 tx=0x7f2e70009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:01.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.008+0000 7f2e6e7fc700 1 -- 172.21.15.151:0/2339857686 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f2e7404eb80 con 0x7f2e80157a20 2022-03-15T05:50:01.196 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.193+0000 7f2e84b27700 1 -- 172.21.15.151:0/2339857686 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f2e8004b760 con 0x7f2e80157a20 2022-03-15T05:50:01.743 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.740+0000 7f2e6e7fc700 1 -- 172.21.15.151:0/2339857686 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2e740170d0 con 0x7f2e80157a20 2022-03-15T05:50:01.749 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.745+0000 7f2e84b27700 1 -- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2e5c0633c0 msgr2=0x7f2e5c065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:01.750 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.745+0000 7f2e84b27700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2e5c0633c0 0x7f2e5c065870 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2e70005750 tx=0x7f2e70009040 comp rx=0 tx=0).stop 2022-03-15T05:50:01.750 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.745+0000 7f2e84b27700 1 -- 172.21.15.151:0/2339857686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e80157a20 msgr2=0x7f2e80151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:01.750 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.745+0000 7f2e84b27700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e80157a20 0x7f2e80151ed0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400e900 tx=0x7f2e74009060 comp rx=0 tx=0).stop 2022-03-15T05:50:01.753 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.750+0000 7f2e84b27700 1 -- 172.21.15.151:0/2339857686 shutdown_connections 2022-03-15T05:50:01.753 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.750+0000 7f2e84b27700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2e5c0633c0 0x7f2e5c065870 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:01.753 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.750+0000 7f2e84b27700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2e80157df0 0x7f2e80158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:01.754 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.750+0000 7f2e84b27700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2e800c2db0 0x7f2e8014d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:01.754 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.750+0000 7f2e84b27700 1 --2- 172.21.15.151:0/2339857686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e80157a20 0x7f2e80151ed0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:01.754 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.750+0000 7f2e84b27700 1 -- 172.21.15.151:0/2339857686 >> 172.21.15.151:0/2339857686 conn(0x7f2e80068ec0 msgr2=0x7f2e8014e730 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:01.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.755+0000 7f2e84b27700 1 -- 172.21.15.151:0/2339857686 shutdown_connections 2022-03-15T05:50:01.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:01.756+0000 7f2e84b27700 1 -- 172.21.15.151:0/2339857686 wait complete. 2022-03-15T05:50:01.765 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'cephfs_data' created 2022-03-15T05:50:01.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2022-03-15T05:50:02.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.000+0000 7f6dffb63700 1 Processor -- start 2022-03-15T05:50:02.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.001+0000 7f6dffb63700 1 -- start start 2022-03-15T05:50:02.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.002+0000 7f6dffb63700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6df8155800 0x7f6df80c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.002+0000 7f6dffb63700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df80c5c70 con 0x7f6df8157a20 2022-03-15T05:50:02.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.002+0000 7f6dffb63700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df80c2920 con 0x7f6df8157df0 2022-03-15T05:50:02.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.002+0000 7f6dffb63700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df80c34c0 con 0x7f6df8155800 2022-03-15T05:50:02.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.002+0000 7f6dfd8ff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f6df8157a20 0x7f6df80cb050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53166/0 (socket says 172.21.15.151:53166) 2022-03-15T05:50:02.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.002+0000 7f6dfd8ff700 1 -- 172.21.15.151:0/2598254688 learned_addr learned my addr 172.21.15.151:0/2598254688 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:02.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.002+0000 7f6dfe100700 1 --2- 172.21.15.151:0/2598254688 >> v2:172.21.15.151:3300/0 conn(0x7f6df8155800 0x7f6df80c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.003+0000 7f6dfc8fd700 1 -- 172.21.15.151:0/2598254688 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2865198025 0 0) 0x7f6df80c5c70 con 0x7f6df8157a20 2022-03-15T05:50:02.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.003+0000 7f6dfe100700 1 -- 172.21.15.151:0/2598254688 >> v1:172.21.15.164:6789/0 conn(0x7f6df8157df0 legacy=0x7f6df80c2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.003+0000 7f6dfe100700 1 -- 172.21.15.151:0/2598254688 >> v1:172.21.15.151:6789/0 conn(0x7f6df8157a20 legacy=0x7f6df80cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.003+0000 7f6dfe100700 1 -- 172.21.15.151:0/2598254688 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df80cb850 con 0x7f6df8155800 2022-03-15T05:50:02.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.003+0000 7f6dfe100700 1 --2- 172.21.15.151:0/2598254688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8155800 0x7f6df80c4b10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009de0 tx=0x7f6df0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3723cb33444ba1 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:02.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.003+0000 7f6dfc8fd700 1 -- 172.21.15.151:0/2598254688 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df000e070 con 0x7f6df8155800 2022-03-15T05:50:02.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.003+0000 7f6dfc8fd700 1 -- 172.21.15.151:0/2598254688 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6df000bbb0 con 0x7f6df8155800 2022-03-15T05:50:02.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.003+0000 7f6dfc8fd700 1 -- 172.21.15.151:0/2598254688 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6df0003860 con 0x7f6df8155800 2022-03-15T05:50:02.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.004+0000 7f6dffb63700 1 -- 172.21.15.151:0/2598254688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8155800 msgr2=0x7f6df80c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.004+0000 7f6dffb63700 1 --2- 172.21.15.151:0/2598254688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8155800 0x7f6df80c4b10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6df0009de0 tx=0x7f6df0009780 comp rx=0 tx=0).stop 2022-03-15T05:50:02.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.004+0000 7f6dffb63700 1 -- 172.21.15.151:0/2598254688 shutdown_connections 2022-03-15T05:50:02.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.004+0000 7f6dffb63700 1 --2- 172.21.15.151:0/2598254688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8155800 0x7f6df80c4b10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.004+0000 7f6dffb63700 1 -- 172.21.15.151:0/2598254688 >> 172.21.15.151:0/2598254688 conn(0x7f6df8068ec0 msgr2=0x7f6df80692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:02.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.004+0000 7f6dffb63700 1 -- 172.21.15.151:0/2598254688 shutdown_connections 2022-03-15T05:50:02.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.004+0000 7f6dffb63700 1 -- 172.21.15.151:0/2598254688 wait complete. 2022-03-15T05:50:02.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.006+0000 7f6dffb63700 1 Processor -- start 2022-03-15T05:50:02.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.007+0000 7f6dffb63700 1 -- start start 2022-03-15T05:50:02.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dffb63700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6df8155800 0x7f6df8169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dffb63700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8157a20 0x7f6df8150900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dffb63700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6df8157df0 0x7f6df80c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dffb63700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df8156a90 con 0x7f6df8157a20 2022-03-15T05:50:02.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dffb63700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df80afd50 con 0x7f6df8155800 2022-03-15T05:50:02.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dffb63700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df816a0f0 con 0x7f6df8157df0 2022-03-15T05:50:02.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dfd0fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8157a20 0x7f6df8150900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dfd0fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8157a20 0x7f6df8150900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59972/0 (socket says 172.21.15.151:59972) 2022-03-15T05:50:02.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dfd0fe700 1 -- 172.21.15.151:0/294986097 learned_addr learned my addr 172.21.15.151:0/294986097 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:02.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dfd8ff700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6df8155800 0x7f6df8169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.008+0000 7f6dfe100700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6df8157df0 0x7f6df80c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6dfd0fe700 1 -- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6df8157df0 msgr2=0x7f6df80c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6dfd0fe700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6df8157df0 0x7f6df80c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6dfd0fe700 1 -- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6df8155800 msgr2=0x7f6df8169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6dfd0fe700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6df8155800 0x7f6df8169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6dfd0fe700 1 -- 172.21.15.151:0/294986097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df0009a20 con 0x7f6df8157a20 2022-03-15T05:50:02.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6dfd0fe700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8157a20 0x7f6df8150900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c5c0 tx=0x7f6de8007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:02.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6de5ffb700 1 -- 172.21.15.151:0/294986097 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de80052e0 con 0x7f6df8157a20 2022-03-15T05:50:02.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6de5ffb700 1 -- 172.21.15.151:0/294986097 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de80034c0 con 0x7f6df8157a20 2022-03-15T05:50:02.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6dffb63700 1 -- 172.21.15.151:0/294986097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df80be950 con 0x7f6df8157a20 2022-03-15T05:50:02.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6de5ffb700 1 -- 172.21.15.151:0/294986097 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8003880 con 0x7f6df8157a20 2022-03-15T05:50:02.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.009+0000 7f6dffb63700 1 -- 172.21.15.151:0/294986097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df80af420 con 0x7f6df8157a20 2022-03-15T05:50:02.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.011+0000 7f6dffb63700 1 -- 172.21.15.151:0/294986097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df804b760 con 0x7f6df8157a20 2022-03-15T05:50:02.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.012+0000 7f6de5ffb700 1 -- 172.21.15.151:0/294986097 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f6de8019030 con 0x7f6df8157a20 2022-03-15T05:50:02.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.013+0000 7f6de5ffb700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6dd80633c0 0x7f6dd8065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.013+0000 7f6de5ffb700 1 -- 172.21.15.151:0/294986097 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f6de807efe0 con 0x7f6df8157a20 2022-03-15T05:50:02.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.013+0000 7f6dfd8ff700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6dd80633c0 0x7f6dd8065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.024 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.014+0000 7f6dfd8ff700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6dd80633c0 0x7f6dd8065870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6df4007fd0 tx=0x7f6df4007d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:02.024 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.018+0000 7f6de5ffb700 1 -- 172.21.15.151:0/294986097 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f6de804e000 con 0x7f6df8157a20 2022-03-15T05:50:02.249 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.246+0000 7f6dffb63700 1 -- 172.21.15.151:0/294986097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f6df80cbb30 con 0x7f6df8157a20 2022-03-15T05:50:02.254 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.252+0000 7f6de5ffb700 1 -- 172.21.15.151:0/294986097 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f6de8017070 con 0x7f6df8157a20 2022-03-15T05:50:02.259 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.256+0000 7f6dffb63700 1 -- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6dd80633c0 msgr2=0x7f6dd8065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.259 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.256+0000 7f6dffb63700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6dd80633c0 0x7f6dd8065870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6df4007fd0 tx=0x7f6df4007d10 comp rx=0 tx=0).stop 2022-03-15T05:50:02.260 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.256+0000 7f6dffb63700 1 -- 172.21.15.151:0/294986097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8157a20 msgr2=0x7f6df8150900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.260 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.256+0000 7f6dffb63700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8157a20 0x7f6df8150900 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6de800c5c0 tx=0x7f6de8007ce0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.260 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.256+0000 7f6dffb63700 1 -- 172.21.15.151:0/294986097 shutdown_connections 2022-03-15T05:50:02.260 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.256+0000 7f6dffb63700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6dd80633c0 0x7f6dd8065870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.261 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.256+0000 7f6dffb63700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6df8157df0 0x7f6df80c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.261 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.256+0000 7f6dffb63700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6df8155800 0x7f6df8169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.261 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.256+0000 7f6dffb63700 1 --2- 172.21.15.151:0/294986097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6df8157a20 0x7f6df8150900 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.261 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.256+0000 7f6dffb63700 1 -- 172.21.15.151:0/294986097 >> 172.21.15.151:0/294986097 conn(0x7f6df8068ec0 msgr2=0x7f6df8069290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:02.262 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.257+0000 7f6dffb63700 1 -- 172.21.15.151:0/294986097 shutdown_connections 2022-03-15T05:50:02.262 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.258+0000 7f6dffb63700 1 -- 172.21.15.151:0/294986097 wait complete. 2022-03-15T05:50:02.266 INFO:teuthology.orchestra.run.smithi151.stderr:new fs with metadata pool 3 and data pool 4 2022-03-15T05:50:02.298 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-15T05:50:02.506 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.502+0000 7fbcaa93e700 1 Processor -- start 2022-03-15T05:50:02.506 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.503+0000 7fbcaa93e700 1 -- start start 2022-03-15T05:50:02.508 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.504+0000 7fbcaa93e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca4062490 0x7fbca406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.504+0000 7fbcaa93e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbca406cb60 0x7fbca406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.504+0000 7fbcaa93e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbca406b590 con 0x7fbca414ea80 2022-03-15T05:50:02.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.504+0000 7fbcaa93e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbca406e570 con 0x7fbca406cb60 2022-03-15T05:50:02.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.504+0000 7fbcaa93e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40c3020 con 0x7fbca4062490 2022-03-15T05:50:02.510 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.504+0000 7fbca3fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fbca414ea80 0x7fbca40c34b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53170/0 (socket says 172.21.15.151:53170) 2022-03-15T05:50:02.510 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.504+0000 7fbca37fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca4062490 0x7fbca406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.510 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.504+0000 7fbca3fff700 1 -- 172.21.15.151:0/4051330699 learned_addr learned my addr 172.21.15.151:0/4051330699 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:02.510 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.504+0000 7fbca8edb700 1 --2- 172.21.15.151:0/4051330699 >> v2:172.21.15.164:3300/0 conn(0x7fbca406cb60 0x7fbca406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.505+0000 7fbca37fe700 1 -- 172.21.15.151:0/4051330699 >> v2:172.21.15.164:3300/0 conn(0x7fbca406cb60 msgr2=0x7fbca406cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:02.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.505+0000 7fbca37fe700 1 --2- 172.21.15.151:0/4051330699 >> v2:172.21.15.164:3300/0 conn(0x7fbca406cb60 0x7fbca406cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.505+0000 7fbca37fe700 1 -- 172.21.15.151:0/4051330699 >> v1:172.21.15.151:6789/0 conn(0x7fbca414ea80 legacy=0x7fbca40c34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.505+0000 7fbca37fe700 1 -- 172.21.15.151:0/4051330699 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca4066980 con 0x7fbca4062490 2022-03-15T05:50:02.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.505+0000 7fbca2ffd700 1 -- 172.21.15.151:0/4051330699 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674380725 0 0) 0x7fbca406b590 con 0x7fbca414ea80 2022-03-15T05:50:02.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.505+0000 7fbca37fe700 1 --2- 172.21.15.151:0/4051330699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca4062490 0x7fbca406eb50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009760 tx=0x7fbc98009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49f67c7f82f68dd2 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:02.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.505+0000 7fbca2ffd700 1 -- 172.21.15.151:0/4051330699 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98011630 con 0x7fbca4062490 2022-03-15T05:50:02.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.506+0000 7fbca2ffd700 1 -- 172.21.15.151:0/4051330699 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc98011790 con 0x7fbca4062490 2022-03-15T05:50:02.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.506+0000 7fbca2ffd700 1 -- 172.21.15.151:0/4051330699 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc98011b50 con 0x7fbca4062490 2022-03-15T05:50:02.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.506+0000 7fbcaa93e700 1 -- 172.21.15.151:0/4051330699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca4062490 msgr2=0x7fbca406eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.506+0000 7fbcaa93e700 1 --2- 172.21.15.151:0/4051330699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca4062490 0x7fbca406eb50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fbc98009760 tx=0x7fbc98009060 comp rx=0 tx=0).stop 2022-03-15T05:50:02.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.506+0000 7fbcaa93e700 1 -- 172.21.15.151:0/4051330699 shutdown_connections 2022-03-15T05:50:02.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.506+0000 7fbcaa93e700 1 --2- 172.21.15.151:0/4051330699 >> v2:172.21.15.164:3300/0 conn(0x7fbca406cb60 0x7fbca406cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.506+0000 7fbcaa93e700 1 --2- 172.21.15.151:0/4051330699 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca4062490 0x7fbca406eb50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.506+0000 7fbcaa93e700 1 -- 172.21.15.151:0/4051330699 >> 172.21.15.151:0/4051330699 conn(0x7fbca40c3e90 msgr2=0x7fbca40c4290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:02.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.506+0000 7fbcaa93e700 1 -- 172.21.15.151:0/4051330699 shutdown_connections 2022-03-15T05:50:02.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.506+0000 7fbcaa93e700 1 -- 172.21.15.151:0/4051330699 wait complete. 2022-03-15T05:50:02.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.508+0000 7fbcaa93e700 1 Processor -- start 2022-03-15T05:50:02.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.508+0000 7fbcaa93e700 1 -- start start 2022-03-15T05:50:02.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbcaa93e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca4062490 0x7fbca41653a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbcaa93e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca406cb60 0x7fbca414bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbcaa93e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbca414ea80 0x7fbca4156260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbcaa93e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca40bb8b0 con 0x7fbca4062490 2022-03-15T05:50:02.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbcaa93e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbca4158590 con 0x7fbca414ea80 2022-03-15T05:50:02.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbcaa93e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbca41658e0 con 0x7fbca406cb60 2022-03-15T05:50:02.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbca3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca4062490 0x7fbca41653a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbca8edb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbca414ea80 0x7fbca4156260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbca3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca4062490 0x7fbca41653a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59974/0 (socket says 172.21.15.151:59974) 2022-03-15T05:50:02.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbca3fff700 1 -- 172.21.15.151:0/1049910916 learned_addr learned my addr 172.21.15.151:0/1049910916 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:02.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.509+0000 7fbca37fe700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca406cb60 0x7fbca414bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbca8edb700 1 -- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca406cb60 msgr2=0x7fbca414bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbca8edb700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca406cb60 0x7fbca414bfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbca8edb700 1 -- 172.21.15.151:0/1049910916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca4062490 msgr2=0x7fbca41653a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbca8edb700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca4062490 0x7fbca41653a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbca8edb700 1 -- 172.21.15.151:0/1049910916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc980092a0 con 0x7fbca414ea80 2022-03-15T05:50:02.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbca3fff700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca4062490 0x7fbca41653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:02.524 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbca8edb700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbca414ea80 0x7fbca4156260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009e50 tx=0x7fbc9c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:02.524 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbc8bfff700 1 -- 172.21.15.151:0/1049910916 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00caa0 con 0x7fbca414ea80 2022-03-15T05:50:02.524 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbc8bfff700 1 -- 172.21.15.151:0/1049910916 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c00f040 con 0x7fbca414ea80 2022-03-15T05:50:02.524 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbcaa93e700 1 -- 172.21.15.151:0/1049910916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca4155fa0 con 0x7fbca414ea80 2022-03-15T05:50:02.525 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.510+0000 7fbc8bfff700 1 -- 172.21.15.151:0/1049910916 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c00ce50 con 0x7fbca414ea80 2022-03-15T05:50:02.525 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.511+0000 7fbcaa93e700 1 -- 172.21.15.151:0/1049910916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbca40bb330 con 0x7fbca414ea80 2022-03-15T05:50:02.525 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.511+0000 7fbcaa93e700 1 -- 172.21.15.151:0/1049910916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbca41586d0 con 0x7fbca414ea80 2022-03-15T05:50:02.525 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.512+0000 7fbc8bfff700 1 -- 172.21.15.151:0/1049910916 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fbc9c014690 con 0x7fbca414ea80 2022-03-15T05:50:02.525 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.513+0000 7fbc8bfff700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbc840633c0 0x7fbc84065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.526 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.513+0000 7fbc8bfff700 1 -- 172.21.15.151:0/1049910916 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbc9c080c80 con 0x7fbca414ea80 2022-03-15T05:50:02.526 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.513+0000 7fbca3fff700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbc840633c0 0x7fbc84065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.526 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.514+0000 7fbca3fff700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbc840633c0 0x7fbc84065870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc940017a0 tx=0x7fbc94007c70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:02.527 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.519+0000 7fbc8bfff700 1 -- 172.21.15.151:0/1049910916 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fbca41586d0 con 0x7fbca414ea80 2022-03-15T05:50:02.710 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.707+0000 7fbcaa93e700 1 -- 172.21.15.151:0/1049910916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbca41586d0 con 0x7fbca414ea80 2022-03-15T05:50:02.711 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.708+0000 7fbc8bfff700 1 -- 172.21.15.151:0/1049910916 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16906 (secure 0 0 0) 0x7fbca41586d0 con 0x7fbca414ea80 2022-03-15T05:50:02.711 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:02.712 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":23,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:50:02.248648+0000","last_up_change":"2022-03-15T05:49:47.305366+0000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-03-15T05:49:46.741897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-03-15T05:49:54.617407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-15T05:49:59.845834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-15T05:50:01.249141+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":35552},{"type":"v1","addr":"172.21.15.151:6801","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":35552},{"type":"v1","addr":"172.21.15.151:6803","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":35552},{"type":"v1","addr":"172.21.15.151:6807","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":35552},{"type":"v1","addr":"172.21.15.151:6805","nonce":35552}]},"public_addr":"172.21.15.151:6801/35552","cluster_addr":"172.21.15.151:6803/35552","heartbeat_back_addr":"172.21.15.151:6807/35552","heartbeat_front_addr":"172.21.15.151:6805/35552","state":["exists","up"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":35554},{"type":"v1","addr":"172.21.15.151:6821","nonce":35554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":35554},{"type":"v1","addr":"172.21.15.151:6825","nonce":35554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":35554},{"type":"v1","addr":"172.21.15.151:6831","nonce":35554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":35554},{"type":"v1","addr":"172.21.15.151:6829","nonce":35554}]},"public_addr":"172.21.15.151:6821/35554","cluster_addr":"172.21.15.151:6825/35554","heartbeat_back_addr":"172.21.15.151:6831/35554","heartbeat_front_addr":"172.21.15.151:6829/35554","state":["exists","up"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":35555},{"type":"v1","addr":"172.21.15.151:6817","nonce":35555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":35555},{"type":"v1","addr":"172.21.15.151:6820","nonce":35555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":35555},{"type":"v1","addr":"172.21.15.151:6828","nonce":35555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":35555},{"type":"v1","addr":"172.21.15.151:6824","nonce":35555}]},"public_addr":"172.21.15.151:6817/35555","cluster_addr":"172.21.15.151:6820/35555","heartbeat_back_addr":"172.21.15.151:6828/35555","heartbeat_front_addr":"172.21.15.151:6824/35555","state":["exists","up"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":35553},{"type":"v1","addr":"172.21.15.151:6809","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":35553},{"type":"v1","addr":"172.21.15.151:6811","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":35553},{"type":"v1","addr":"172.21.15.151:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":35553},{"type":"v1","addr":"172.21.15.151:6813","nonce":35553}]},"public_addr":"172.21.15.151:6809/35553","cluster_addr":"172.21.15.151:6811/35553","heartbeat_back_addr":"172.21.15.151:6815/35553","heartbeat_front_addr":"172.21.15.151:6813/35553","state":["exists","up"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":41130},{"type":"v1","addr":"172.21.15.164:6825","nonce":41130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":41130},{"type":"v1","addr":"172.21.15.164:6827","nonce":41130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":41130},{"type":"v1","addr":"172.21.15.164:6831","nonce":41130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":41130},{"type":"v1","addr":"172.21.15.164:6829","nonce":41130}]},"public_addr":"172.21.15.164:6825/41130","cluster_addr":"172.21.15.164:6827/41130","heartbeat_back_addr":"172.21.15.164:6831/41130","heartbeat_front_addr":"172.21.15.164:6829/41130","state":["exists","up"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":41119},{"type":"v1","addr":"172.21.15.164:6801","nonce":41119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":41119},{"type":"v1","addr":"172.21.15.164:6803","nonce":41119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":41119},{"type":"v1","addr":"172.21.15.164:6807","nonce":41119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":41119},{"type":"v1","addr":"172.21.15.164:6805","nonce":41119}]},"public_addr":"172.21.15.164:6801/41119","cluster_addr":"172.21.15.164:6803/41119","heartbeat_back_addr":"172.21.15.164:6807/41119","heartbeat_front_addr":"172.21.15.164:6805/41119","state":["exists","up"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":41129},{"type":"v1","addr":"172.21.15.164:6817","nonce":41129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":41129},{"type":"v1","addr":"172.21.15.164:6819","nonce":41129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":41129},{"type":"v1","addr":"172.21.15.164:6823","nonce":41129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":41129},{"type":"v1","addr":"172.21.15.164:6821","nonce":41129}]},"public_addr":"172.21.15.164:6817/41129","cluster_addr":"172.21.15.164:6819/41129","heartbeat_back_addr":"172.21.15.164:6823/41129","heartbeat_front_addr":"172.21.15.164:6821/41129","state":["exists","up"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":41120},{"type":"v1","addr":"172.21.15.164:6809","nonce":41120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":41120},{"type":"v1","addr":"172.21.15.164:6811","nonce":41120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":41120},{"type":"v1","addr":"172.21.15.164:6816","nonce":41120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":41120},{"type":"v1","addr":"172.21.15.164:6813","nonce":41120}]},"public_addr":"172.21.15.164:6809/41120","cluster_addr":"172.21.15.164:6811/41120","heartbeat_back_addr":"172.21.15.164:6816/41120","heartbeat_front_addr":"172.21.15.164:6813/41120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.378836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.466901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.764352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.688587+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.304917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.236409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.231122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.208581+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:50:02.713 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 -- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbc840633c0 msgr2=0x7fbc84065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.714 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbc840633c0 0x7fbc84065870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fbc940017a0 tx=0x7fbc94007c70 comp rx=0 tx=0).stop 2022-03-15T05:50:02.714 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 -- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbca414ea80 msgr2=0x7fbca4156260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.714 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbca414ea80 0x7fbca4156260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009e50 tx=0x7fbc9c00b040 comp rx=0 tx=0).stop 2022-03-15T05:50:02.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 -- 172.21.15.151:0/1049910916 shutdown_connections 2022-03-15T05:50:02.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbc840633c0 0x7fbc84065870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbca414ea80 0x7fbca4156260 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbca4062490 0x7fbca41653a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 --2- 172.21.15.151:0/1049910916 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbca406cb60 0x7fbca414bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 -- 172.21.15.151:0/1049910916 >> 172.21.15.151:0/1049910916 conn(0x7fbca40c3e90 msgr2=0x7fbca414df20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 -- 172.21.15.151:0/1049910916 shutdown_connections 2022-03-15T05:50:02.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.711+0000 7fbcaa93e700 1 -- 172.21.15.151:0/1049910916 wait complete. 2022-03-15T05:50:02.738 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-15T05:50:02.944 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.941+0000 7f872767d700 1 Processor -- start 2022-03-15T05:50:02.945 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.942+0000 7f872767d700 1 -- start start 2022-03-15T05:50:02.946 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.943+0000 7f872767d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f87200c3d70 0x7f8720067b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.947 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.943+0000 7f872767d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006eaa0 0x7f87200c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.947 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.943+0000 7f872767d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8720068060 con 0x7f872006e6d0 2022-03-15T05:50:02.947 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.943+0000 7f872767d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8720066d50 con 0x7f87200c3d70 2022-03-15T05:50:02.947 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.943+0000 7f872767d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87200678f0 con 0x7f872006eaa0 2022-03-15T05:50:02.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.943+0000 7f8724c18700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f87200c3d70 0x7f8720067b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.943+0000 7f8725419700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f872006e6d0 0x7f87200671e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33638/0 (socket says 172.21.15.151:33638) 2022-03-15T05:50:02.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.943+0000 7f8725419700 1 -- 172.21.15.151:0/4182989793 learned_addr learned my addr 172.21.15.151:0/4182989793 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:02.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.943+0000 7f8725c1a700 1 --2- 172.21.15.151:0/4182989793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006eaa0 0x7f87200c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.944+0000 7f8724c18700 1 -- 172.21.15.151:0/4182989793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006eaa0 msgr2=0x7f87200c05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:02.949 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.944+0000 7f8724c18700 1 --2- 172.21.15.151:0/4182989793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006eaa0 0x7f87200c05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.949 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.944+0000 7f8724c18700 1 -- 172.21.15.151:0/4182989793 >> v1:172.21.15.164:6789/0 conn(0x7f872006e6d0 legacy=0x7f87200671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.949 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.944+0000 7f8724c18700 1 -- 172.21.15.151:0/4182989793 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720066a20 con 0x7f87200c3d70 2022-03-15T05:50:02.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.944+0000 7f8724c18700 1 --2- 172.21.15.151:0/4182989793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87200c3d70 0x7f8720067b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8710009760 tx=0x7f8710009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0926f7d39649790 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:02.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.944+0000 7f870ffff700 1 -- 172.21.15.151:0/4182989793 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710011630 con 0x7f87200c3d70 2022-03-15T05:50:02.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.944+0000 7f870ffff700 1 -- 172.21.15.151:0/4182989793 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710011790 con 0x7f87200c3d70 2022-03-15T05:50:02.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.944+0000 7f870ffff700 1 -- 172.21.15.151:0/4182989793 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710011b50 con 0x7f87200c3d70 2022-03-15T05:50:02.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.945+0000 7f872767d700 1 -- 172.21.15.151:0/4182989793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87200c3d70 msgr2=0x7f8720067b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.945+0000 7f872767d700 1 --2- 172.21.15.151:0/4182989793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87200c3d70 0x7f8720067b20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8710009760 tx=0x7f8710009060 comp rx=0 tx=0).stop 2022-03-15T05:50:02.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.945+0000 7f872767d700 1 -- 172.21.15.151:0/4182989793 shutdown_connections 2022-03-15T05:50:02.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.945+0000 7f872767d700 1 --2- 172.21.15.151:0/4182989793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006eaa0 0x7f87200c05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.945+0000 7f872767d700 1 --2- 172.21.15.151:0/4182989793 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87200c3d70 0x7f8720067b20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.945+0000 7f872767d700 1 -- 172.21.15.151:0/4182989793 >> 172.21.15.151:0/4182989793 conn(0x7f87200c75c0 msgr2=0x7f87200c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:02.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.945+0000 7f872767d700 1 -- 172.21.15.151:0/4182989793 shutdown_connections 2022-03-15T05:50:02.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.945+0000 7f872767d700 1 -- 172.21.15.151:0/4182989793 wait complete. 2022-03-15T05:50:02.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.947+0000 7f872767d700 1 Processor -- start 2022-03-15T05:50:02.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.947+0000 7f872767d700 1 -- start start 2022-03-15T05:50:02.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f872767d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006e6d0 0x7f8720162f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f872767d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006eaa0 0x7f872014eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f872767d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87200c3d70 0x7f87200c19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f872767d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87201501a0 con 0x7f872006eaa0 2022-03-15T05:50:02.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f872767d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f872014e700 con 0x7f87200c3d70 2022-03-15T05:50:02.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f872767d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8720163480 con 0x7f872006e6d0 2022-03-15T05:50:02.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f8725419700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006e6d0 0x7f8720162f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f8724c18700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006eaa0 0x7f872014eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f8725c1a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87200c3d70 0x7f87200c19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f8725419700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006e6d0 0x7f8720162f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60090/0 (socket says 172.21.15.151:60090) 2022-03-15T05:50:02.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f8724c18700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006eaa0 0x7f872014eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59978/0 (socket says 172.21.15.151:59978) 2022-03-15T05:50:02.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f8725419700 1 -- 172.21.15.151:0/2648830398 learned_addr learned my addr 172.21.15.151:0/2648830398 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:02.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.948+0000 7f8725c1a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87200c3d70 0x7f87200c19e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57198/0 (socket says 172.21.15.151:57198) 2022-03-15T05:50:02.960 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.949+0000 7f8724c18700 1 -- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006e6d0 msgr2=0x7f8720162f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.960 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.949+0000 7f8724c18700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006e6d0 0x7f8720162f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.960 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.949+0000 7f8724c18700 1 -- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87200c3d70 msgr2=0x7f87200c19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:02.960 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.949+0000 7f8724c18700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87200c3d70 0x7f87200c19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:02.961 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.949+0000 7f8724c18700 1 -- 172.21.15.151:0/2648830398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87100092a0 con 0x7f872006eaa0 2022-03-15T05:50:02.961 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.949+0000 7f8724c18700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006eaa0 0x7f872014eb90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8720069540 tx=0x7f8710017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:02.961 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.949+0000 7f870d7fa700 1 -- 172.21.15.151:0/2648830398 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8710011900 con 0x7f872006eaa0 2022-03-15T05:50:02.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.949+0000 7f870d7fa700 1 -- 172.21.15.151:0/2648830398 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8710011a80 con 0x7f872006eaa0 2022-03-15T05:50:02.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.949+0000 7f870d7fa700 1 -- 172.21.15.151:0/2648830398 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87100042a0 con 0x7f872006eaa0 2022-03-15T05:50:02.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.949+0000 7f872767d700 1 -- 172.21.15.151:0/2648830398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f872014f900 con 0x7f872006eaa0 2022-03-15T05:50:02.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.950+0000 7f872767d700 1 -- 172.21.15.151:0/2648830398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f872014fec0 con 0x7f872006eaa0 2022-03-15T05:50:02.963 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.951+0000 7f872767d700 1 -- 172.21.15.151:0/2648830398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87201533d0 con 0x7f872006eaa0 2022-03-15T05:50:02.964 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.951+0000 7f870d7fa700 1 -- 172.21.15.151:0/2648830398 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f871002b030 con 0x7f872006eaa0 2022-03-15T05:50:02.964 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.952+0000 7f870d7fa700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f87000633f0 0x7f87000658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:02.964 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.952+0000 7f870d7fa700 1 -- 172.21.15.151:0/2648830398 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8710081340 con 0x7f872006eaa0 2022-03-15T05:50:02.964 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.952+0000 7f8725419700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f87000633f0 0x7f87000658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:02.965 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.953+0000 7f8725419700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f87000633f0 0x7f87000658a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f871c004780 tx=0x7f871c007e80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:02.965 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:02.956+0000 7f870d7fa700 1 -- 172.21.15.151:0/2648830398 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f8710050320 con 0x7f872006eaa0 2022-03-15T05:50:03.143 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.140+0000 7f872767d700 1 -- 172.21.15.151:0/2648830398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f872014e870 con 0x7f872006eaa0 2022-03-15T05:50:03.144 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.141+0000 7f870d7fa700 1 -- 172.21.15.151:0/2648830398 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16906 (secure 0 0 0) 0x7f8710015090 con 0x7f872006eaa0 2022-03-15T05:50:03.144 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:03.145 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":23,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:50:02.248648+0000","last_up_change":"2022-03-15T05:49:47.305366+0000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-03-15T05:49:46.741897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-03-15T05:49:54.617407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-15T05:49:59.845834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-15T05:50:01.249141+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":35552},{"type":"v1","addr":"172.21.15.151:6801","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":35552},{"type":"v1","addr":"172.21.15.151:6803","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":35552},{"type":"v1","addr":"172.21.15.151:6807","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":35552},{"type":"v1","addr":"172.21.15.151:6805","nonce":35552}]},"public_addr":"172.21.15.151:6801/35552","cluster_addr":"172.21.15.151:6803/35552","heartbeat_back_addr":"172.21.15.151:6807/35552","heartbeat_front_addr":"172.21.15.151:6805/35552","state":["exists","up"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":35554},{"type":"v1","addr":"172.21.15.151:6821","nonce":35554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":35554},{"type":"v1","addr":"172.21.15.151:6825","nonce":35554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":35554},{"type":"v1","addr":"172.21.15.151:6831","nonce":35554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":35554},{"type":"v1","addr":"172.21.15.151:6829","nonce":35554}]},"public_addr":"172.21.15.151:6821/35554","cluster_addr":"172.21.15.151:6825/35554","heartbeat_back_addr":"172.21.15.151:6831/35554","heartbeat_front_addr":"172.21.15.151:6829/35554","state":["exists","up"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":35555},{"type":"v1","addr":"172.21.15.151:6817","nonce":35555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":35555},{"type":"v1","addr":"172.21.15.151:6820","nonce":35555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":35555},{"type":"v1","addr":"172.21.15.151:6828","nonce":35555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":35555},{"type":"v1","addr":"172.21.15.151:6824","nonce":35555}]},"public_addr":"172.21.15.151:6817/35555","cluster_addr":"172.21.15.151:6820/35555","heartbeat_back_addr":"172.21.15.151:6828/35555","heartbeat_front_addr":"172.21.15.151:6824/35555","state":["exists","up"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":35553},{"type":"v1","addr":"172.21.15.151:6809","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":35553},{"type":"v1","addr":"172.21.15.151:6811","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":35553},{"type":"v1","addr":"172.21.15.151:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":35553},{"type":"v1","addr":"172.21.15.151:6813","nonce":35553}]},"public_addr":"172.21.15.151:6809/35553","cluster_addr":"172.21.15.151:6811/35553","heartbeat_back_addr":"172.21.15.151:6815/35553","heartbeat_front_addr":"172.21.15.151:6813/35553","state":["exists","up"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":41130},{"type":"v1","addr":"172.21.15.164:6825","nonce":41130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":41130},{"type":"v1","addr":"172.21.15.164:6827","nonce":41130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":41130},{"type":"v1","addr":"172.21.15.164:6831","nonce":41130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":41130},{"type":"v1","addr":"172.21.15.164:6829","nonce":41130}]},"public_addr":"172.21.15.164:6825/41130","cluster_addr":"172.21.15.164:6827/41130","heartbeat_back_addr":"172.21.15.164:6831/41130","heartbeat_front_addr":"172.21.15.164:6829/41130","state":["exists","up"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":41119},{"type":"v1","addr":"172.21.15.164:6801","nonce":41119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":41119},{"type":"v1","addr":"172.21.15.164:6803","nonce":41119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":41119},{"type":"v1","addr":"172.21.15.164:6807","nonce":41119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":41119},{"type":"v1","addr":"172.21.15.164:6805","nonce":41119}]},"public_addr":"172.21.15.164:6801/41119","cluster_addr":"172.21.15.164:6803/41119","heartbeat_back_addr":"172.21.15.164:6807/41119","heartbeat_front_addr":"172.21.15.164:6805/41119","state":["exists","up"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":41129},{"type":"v1","addr":"172.21.15.164:6817","nonce":41129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":41129},{"type":"v1","addr":"172.21.15.164:6819","nonce":41129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":41129},{"type":"v1","addr":"172.21.15.164:6823","nonce":41129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":41129},{"type":"v1","addr":"172.21.15.164:6821","nonce":41129}]},"public_addr":"172.21.15.164:6817/41129","cluster_addr":"172.21.15.164:6819/41129","heartbeat_back_addr":"172.21.15.164:6823/41129","heartbeat_front_addr":"172.21.15.164:6821/41129","state":["exists","up"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":41120},{"type":"v1","addr":"172.21.15.164:6809","nonce":41120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":41120},{"type":"v1","addr":"172.21.15.164:6811","nonce":41120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":41120},{"type":"v1","addr":"172.21.15.164:6816","nonce":41120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":41120},{"type":"v1","addr":"172.21.15.164:6813","nonce":41120}]},"public_addr":"172.21.15.164:6809/41120","cluster_addr":"172.21.15.164:6811/41120","heartbeat_back_addr":"172.21.15.164:6816/41120","heartbeat_front_addr":"172.21.15.164:6813/41120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.378836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.466901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.764352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.688587+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.304917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.236409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.231122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.208581+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:50:03.147 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 -- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f87000633f0 msgr2=0x7f87000658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:03.147 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f87000633f0 0x7f87000658a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f871c004780 tx=0x7f871c007e80 comp rx=0 tx=0).stop 2022-03-15T05:50:03.147 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 -- 172.21.15.151:0/2648830398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006eaa0 msgr2=0x7f872014eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:03.147 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006eaa0 0x7f872014eb90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8720069540 tx=0x7f8710017000 comp rx=0 tx=0).stop 2022-03-15T05:50:03.148 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 -- 172.21.15.151:0/2648830398 shutdown_connections 2022-03-15T05:50:03.148 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f87000633f0 0x7f87000658a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:03.148 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87200c3d70 0x7f87200c19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:03.148 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f872006e6d0 0x7f8720162f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:03.149 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 --2- 172.21.15.151:0/2648830398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f872006eaa0 0x7f872014eb90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:03.149 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 -- 172.21.15.151:0/2648830398 >> 172.21.15.151:0/2648830398 conn(0x7f87200c75c0 msgr2=0x7f87200671e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:03.149 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 -- 172.21.15.151:0/2648830398 shutdown_connections 2022-03-15T05:50:03.149 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.143+0000 7f872767d700 1 -- 172.21.15.151:0/2648830398 wait complete. 2022-03-15T05:50:03.171 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2022-03-15T05:50:03.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.381+0000 7f065419e700 1 Processor -- start 2022-03-15T05:50:03.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.381+0000 7f065419e700 1 -- start start 2022-03-15T05:50:03.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.381+0000 7f065419e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c157a20 0x7f064c155800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:03.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.381+0000 7f065419e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f064c157df0 0x7f064c0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:03.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.381+0000 7f065419e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c0c5c70 con 0x7f064c0c2db0 2022-03-15T05:50:03.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.381+0000 7f065419e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c0c2920 con 0x7f064c157df0 2022-03-15T05:50:03.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.381+0000 7f065419e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c155d40 con 0x7f064c157a20 2022-03-15T05:50:03.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.381+0000 7f065273b700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f064c0c2db0 0x7f064c0c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53172/0 (socket says 172.21.15.151:53172) 2022-03-15T05:50:03.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.381+0000 7f065273b700 1 -- 172.21.15.151:0/1932653754 learned_addr learned my addr 172.21.15.151:0/1932653754 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:03.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.381+0000 7f0651739700 1 --2- 172.21.15.151:0/1932653754 >> v2:172.21.15.164:3300/0 conn(0x7f064c157df0 0x7f064c0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:03.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f0651f3a700 1 --2- 172.21.15.151:0/1932653754 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c157a20 0x7f064c155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:03.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f0651f3a700 1 -- 172.21.15.151:0/1932653754 >> v2:172.21.15.164:3300/0 conn(0x7f064c157df0 msgr2=0x7f064c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:03.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f0651f3a700 1 --2- 172.21.15.151:0/1932653754 >> v2:172.21.15.164:3300/0 conn(0x7f064c157df0 0x7f064c0cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:03.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f0651f3a700 1 -- 172.21.15.151:0/1932653754 >> v1:172.21.15.151:6789/0 conn(0x7f064c0c2db0 legacy=0x7f064c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:03.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f0651f3a700 1 -- 172.21.15.151:0/1932653754 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0cb590 con 0x7f064c157a20 2022-03-15T05:50:03.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f0650f38700 1 -- 172.21.15.151:0/1932653754 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 440344360 0 0) 0x7f064c0c5c70 con 0x7f064c0c2db0 2022-03-15T05:50:03.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f0651f3a700 1 --2- 172.21.15.151:0/1932653754 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c157a20 0x7f064c155800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f064c0cb780 tx=0x7f0648009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=892ed5c71ef0f8c8 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:03.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f0650f38700 1 -- 172.21.15.151:0/1932653754 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648011630 con 0x7f064c157a20 2022-03-15T05:50:03.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f0650f38700 1 -- 172.21.15.151:0/1932653754 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648011790 con 0x7f064c157a20 2022-03-15T05:50:03.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f0650f38700 1 -- 172.21.15.151:0/1932653754 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648011b50 con 0x7f064c157a20 2022-03-15T05:50:03.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f065419e700 1 -- 172.21.15.151:0/1932653754 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c157a20 msgr2=0x7f064c155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:03.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f065419e700 1 --2- 172.21.15.151:0/1932653754 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c157a20 0x7f064c155800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f064c0cb780 tx=0x7f0648009060 comp rx=0 tx=0).stop 2022-03-15T05:50:03.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f065419e700 1 -- 172.21.15.151:0/1932653754 shutdown_connections 2022-03-15T05:50:03.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f065419e700 1 --2- 172.21.15.151:0/1932653754 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c157a20 0x7f064c155800 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:03.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f065419e700 1 --2- 172.21.15.151:0/1932653754 >> v2:172.21.15.164:3300/0 conn(0x7f064c157df0 0x7f064c0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:03.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f065419e700 1 -- 172.21.15.151:0/1932653754 >> 172.21.15.151:0/1932653754 conn(0x7f064c068ec0 msgr2=0x7f064c0692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:03.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f065419e700 1 -- 172.21.15.151:0/1932653754 shutdown_connections 2022-03-15T05:50:03.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.383+0000 7f065419e700 1 -- 172.21.15.151:0/1932653754 wait complete. 2022-03-15T05:50:03.396 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.386+0000 7f065419e700 1 Processor -- start 2022-03-15T05:50:03.396 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.386+0000 7f065419e700 1 -- start start 2022-03-15T05:50:03.396 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f065419e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c0c2db0 0x7f064c14b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:03.396 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f065419e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f064c157a20 0x7f064c0ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:03.396 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f065419e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f064c157df0 0x7f064c145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:03.397 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f065419e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c152c60 con 0x7f064c157df0 2022-03-15T05:50:03.397 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f065419e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0c69f0 con 0x7f064c157a20 2022-03-15T05:50:03.397 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f065419e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0c7670 con 0x7f064c0c2db0 2022-03-15T05:50:03.397 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651f3a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c0c2db0 0x7f064c14b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:03.398 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f065273b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f064c157df0 0x7f064c145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:03.398 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651f3a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c0c2db0 0x7f064c14b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60096/0 (socket says 172.21.15.151:60096) 2022-03-15T05:50:03.398 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651f3a700 1 -- 172.21.15.151:0/318967161 learned_addr learned my addr 172.21.15.151:0/318967161 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:03.398 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651739700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f064c157a20 0x7f064c0ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:03.399 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651f3a700 1 -- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f064c157a20 msgr2=0x7f064c0ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:03.399 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651f3a700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f064c157a20 0x7f064c0ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:03.399 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651f3a700 1 -- 172.21.15.151:0/318967161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f064c157df0 msgr2=0x7f064c145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:03.399 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651f3a700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f064c157df0 0x7f064c145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:03.400 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651f3a700 1 -- 172.21.15.151:0/318967161 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06480092a0 con 0x7f064c0c2db0 2022-03-15T05:50:03.400 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651739700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f064c157a20 0x7f064c0ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:03.400 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f065273b700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f064c157df0 0x7f064c145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:03.400 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0651f3a700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c0c2db0 0x7f064c14b590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0648011fd0 tx=0x7f0648017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:03.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0639ffb700 1 -- 172.21.15.151:0/318967161 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06480036f0 con 0x7f064c0c2db0 2022-03-15T05:50:03.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0639ffb700 1 -- 172.21.15.151:0/318967161 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0648003850 con 0x7f064c0c2db0 2022-03-15T05:50:03.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f0639ffb700 1 -- 172.21.15.151:0/318967161 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648003c10 con 0x7f064c0c2db0 2022-03-15T05:50:03.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f065419e700 1 -- 172.21.15.151:0/318967161 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c0c6cb0 con 0x7f064c0c2db0 2022-03-15T05:50:03.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.387+0000 7f065419e700 1 -- 172.21.15.151:0/318967161 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c0c7c10 con 0x7f064c0c2db0 2022-03-15T05:50:03.402 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.389+0000 7f065419e700 1 -- 172.21.15.151:0/318967161 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c152e10 con 0x7f064c0c2db0 2022-03-15T05:50:03.402 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.390+0000 7f0639ffb700 1 -- 172.21.15.151:0/318967161 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f064802a020 con 0x7f064c0c2db0 2022-03-15T05:50:03.402 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.390+0000 7f0639ffb700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f062c0633c0 0x7f062c065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:03.402 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.390+0000 7f0639ffb700 1 -- 172.21.15.151:0/318967161 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0648080f80 con 0x7f064c0c2db0 2022-03-15T05:50:03.403 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.390+0000 7f0651739700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f062c0633c0 0x7f062c065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:03.403 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.392+0000 7f0651739700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f062c0633c0 0x7f062c065870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f064c14ea10 tx=0x7f063c009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:03.403 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.396+0000 7f0639ffb700 1 -- 172.21.15.151:0/318967161 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f064c152e10 con 0x7f064c0c2db0 2022-03-15T05:50:03.623 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:03.621+0000 7f065419e700 1 -- 172.21.15.151:0/318967161 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f064c0c98f0 con 0x7f064c0c2db0 2022-03-15T05:50:04.262 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.260+0000 7f0639ffb700 1 -- 172.21.15.151:0/318967161 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0648050010 con 0x7f064c0c2db0 2022-03-15T05:50:04.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.262+0000 7f065419e700 1 -- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f062c0633c0 msgr2=0x7f062c065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:04.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.262+0000 7f065419e700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f062c0633c0 0x7f062c065870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f064c14ea10 tx=0x7f063c009060 comp rx=0 tx=0).stop 2022-03-15T05:50:04.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.262+0000 7f065419e700 1 -- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c0c2db0 msgr2=0x7f064c14b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:04.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.262+0000 7f065419e700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c0c2db0 0x7f064c14b590 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0648011fd0 tx=0x7f0648017000 comp rx=0 tx=0).stop 2022-03-15T05:50:04.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.262+0000 7f065419e700 1 -- 172.21.15.151:0/318967161 shutdown_connections 2022-03-15T05:50:04.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.262+0000 7f065419e700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f062c0633c0 0x7f062c065870 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:04.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.263+0000 7f065419e700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f064c157df0 0x7f064c145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:04.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.263+0000 7f065419e700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f064c0c2db0 0x7f064c14b590 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:04.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.263+0000 7f065419e700 1 --2- 172.21.15.151:0/318967161 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f064c157a20 0x7f064c0ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:04.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.263+0000 7f065419e700 1 -- 172.21.15.151:0/318967161 >> 172.21.15.151:0/318967161 conn(0x7f064c068ec0 msgr2=0x7f064c1569d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:04.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.263+0000 7f065419e700 1 -- 172.21.15.151:0/318967161 shutdown_connections 2022-03-15T05:50:04.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.263+0000 7f065419e700 1 -- 172.21.15.151:0/318967161 wait complete. 2022-03-15T05:50:04.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2022-03-15T05:50:04.504 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.502+0000 7f4dec80a700 1 Processor -- start 2022-03-15T05:50:04.504 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.502+0000 7f4dec80a700 1 -- start start 2022-03-15T05:50:04.508 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.503+0000 7f4dec80a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4de8155240 0x7f4de8155610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:04.508 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.503+0000 7f4dec80a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de80ba8c0 con 0x7f4de8155bc0 2022-03-15T05:50:04.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.503+0000 7f4dec80a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de80c1840 con 0x7f4de8152fb0 2022-03-15T05:50:04.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.503+0000 7f4dec80a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de80c1b20 con 0x7f4de8155240 2022-03-15T05:50:04.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.503+0000 7f4de659c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4de8155240 0x7f4de8155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:04.510 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.503+0000 7f4de6d9d700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f4de8155bc0 0x7f4de80ba1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53174/0 (socket says 172.21.15.151:53174) 2022-03-15T05:50:04.510 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.503+0000 7f4de6d9d700 1 -- 172.21.15.151:0/3729134847 learned_addr learned my addr 172.21.15.151:0/3729134847 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:04.510 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.504+0000 7f4de559a700 1 -- 172.21.15.151:0/3729134847 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3728470987 0 0) 0x7f4de80c1840 con 0x7f4de8152fb0 2022-03-15T05:50:04.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.504+0000 7f4de559a700 1 -- 172.21.15.151:0/3729134847 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dcc0033f0 con 0x7f4de8152fb0 2022-03-15T05:50:04.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.504+0000 7f4de559a700 1 -- 172.21.15.151:0/3729134847 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114289985 0 0) 0x7f4de80ba8c0 con 0x7f4de8155bc0 2022-03-15T05:50:04.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.504+0000 7f4de659c700 1 -- 172.21.15.151:0/3729134847 >> v1:172.21.15.164:6789/0 conn(0x7f4de8152fb0 legacy=0x7f4de80c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:04.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.504+0000 7f4de659c700 1 -- 172.21.15.151:0/3729134847 >> v1:172.21.15.151:6789/0 conn(0x7f4de8155bc0 legacy=0x7f4de80ba1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:04.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.504+0000 7f4de659c700 1 -- 172.21.15.151:0/3729134847 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de80c1e00 con 0x7f4de8155240 2022-03-15T05:50:04.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.504+0000 7f4de659c700 1 --2- 172.21.15.151:0/3729134847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8155240 0x7f4de8155610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009760 tx=0x7f4dd8009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6160b1bc20e84079 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:04.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.505+0000 7f4de559a700 1 -- 172.21.15.151:0/3729134847 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8011630 con 0x7f4de8155240 2022-03-15T05:50:04.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.505+0000 7f4de559a700 1 -- 172.21.15.151:0/3729134847 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd8011790 con 0x7f4de8155240 2022-03-15T05:50:04.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.505+0000 7f4de559a700 1 -- 172.21.15.151:0/3729134847 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8011b30 con 0x7f4de8155240 2022-03-15T05:50:04.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.505+0000 7f4dec80a700 1 -- 172.21.15.151:0/3729134847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8155240 msgr2=0x7f4de8155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:04.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.505+0000 7f4dec80a700 1 --2- 172.21.15.151:0/3729134847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8155240 0x7f4de8155610 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009760 tx=0x7f4dd8009060 comp rx=0 tx=0).stop 2022-03-15T05:50:04.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.505+0000 7f4dec80a700 1 -- 172.21.15.151:0/3729134847 shutdown_connections 2022-03-15T05:50:04.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.505+0000 7f4dec80a700 1 --2- 172.21.15.151:0/3729134847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8155240 0x7f4de8155610 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:04.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.505+0000 7f4dec80a700 1 -- 172.21.15.151:0/3729134847 >> 172.21.15.151:0/3729134847 conn(0x7f4de806aa60 msgr2=0x7f4de80c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:04.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.505+0000 7f4dec80a700 1 -- 172.21.15.151:0/3729134847 shutdown_connections 2022-03-15T05:50:04.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.505+0000 7f4dec80a700 1 -- 172.21.15.151:0/3729134847 wait complete. 2022-03-15T05:50:04.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.507+0000 7f4dec80a700 1 Processor -- start 2022-03-15T05:50:04.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.507+0000 7f4dec80a700 1 -- start start 2022-03-15T05:50:04.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4dec80a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8152fb0 0x7f4de80c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4dec80a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de8155240 0x7f4de8165460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4dec80a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de8155bc0 0x7f4de814e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4dec80a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de8164d50 con 0x7f4de8152fb0 2022-03-15T05:50:04.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4dec80a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80bd980 con 0x7f4de8155240 2022-03-15T05:50:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4dec80a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de80baa90 con 0x7f4de8155bc0 2022-03-15T05:50:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4de659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8152fb0 0x7f4de80c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:04.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4de5d9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de8155240 0x7f4de8165460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:04.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4de659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8152fb0 0x7f4de80c51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59984/0 (socket says 172.21.15.151:59984) 2022-03-15T05:50:04.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4de659c700 1 -- 172.21.15.151:0/3192182450 learned_addr learned my addr 172.21.15.151:0/3192182450 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:04.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.508+0000 7f4de6d9d700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de8155bc0 0x7f4de814e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:04.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.509+0000 7f4de659c700 1 -- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de8155bc0 msgr2=0x7f4de814e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:04.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.509+0000 7f4de659c700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de8155bc0 0x7f4de814e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:04.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.509+0000 7f4de659c700 1 -- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de8155240 msgr2=0x7f4de8165460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:04.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.509+0000 7f4de659c700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de8155240 0x7f4de8165460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:04.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.509+0000 7f4de659c700 1 -- 172.21.15.151:0/3192182450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd80092a0 con 0x7f4de8152fb0 2022-03-15T05:50:04.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.509+0000 7f4de659c700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8152fb0 0x7f4de80c51a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009e00 tx=0x7f4dd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:04.524 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.509+0000 7f4dd67fc700 1 -- 172.21.15.151:0/3192182450 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8000bc0 con 0x7f4de8152fb0 2022-03-15T05:50:04.524 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.509+0000 7f4dd67fc700 1 -- 172.21.15.151:0/3192182450 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd8011900 con 0x7f4de8152fb0 2022-03-15T05:50:04.524 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.509+0000 7f4dd67fc700 1 -- 172.21.15.151:0/3192182450 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd8026430 con 0x7f4de8152fb0 2022-03-15T05:50:04.524 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.509+0000 7f4dec80a700 1 -- 172.21.15.151:0/3192182450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de8164fd0 con 0x7f4de8152fb0 2022-03-15T05:50:04.525 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.510+0000 7f4dec80a700 1 -- 172.21.15.151:0/3192182450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de80b9740 con 0x7f4de8152fb0 2022-03-15T05:50:04.525 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.511+0000 7f4dec80a700 1 -- 172.21.15.151:0/3192182450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de81652b0 con 0x7f4de8152fb0 2022-03-15T05:50:04.525 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.511+0000 7f4dd67fc700 1 -- 172.21.15.151:0/3192182450 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f4dd802c020 con 0x7f4de8152fb0 2022-03-15T05:50:04.525 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.512+0000 7f4dd67fc700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633c0 0x7f4dc4065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:04.526 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.512+0000 7f4dd67fc700 1 -- 172.21.15.151:0/3192182450 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4dd80813f0 con 0x7f4de8152fb0 2022-03-15T05:50:04.526 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.512+0000 7f4de5d9b700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633c0 0x7f4dc4065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:04.526 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.513+0000 7f4de5d9b700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633c0 0x7f4dc4065870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4de80c4660 tx=0x7f4ddc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:04.526 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.516+0000 7f4dd67fc700 1 -- 172.21.15.151:0/3192182450 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f4dd8050420 con 0x7f4de8152fb0 2022-03-15T05:50:04.745 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:04.743+0000 7f4dec80a700 1 -- 172.21.15.151:0/3192182450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f4de804b760 con 0x7f4de8152fb0 2022-03-15T05:50:05.263 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.260+0000 7f4dd67fc700 1 -- 172.21.15.151:0/3192182450 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4dd8053a40 con 0x7f4de8152fb0 2022-03-15T05:50:05.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 -- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633c0 msgr2=0x7f4dc4065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:05.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633c0 0x7f4dc4065870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4de80c4660 tx=0x7f4ddc009040 comp rx=0 tx=0).stop 2022-03-15T05:50:05.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 -- 172.21.15.151:0/3192182450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8152fb0 msgr2=0x7f4de80c51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:05.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8152fb0 0x7f4de80c51a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8009e00 tx=0x7f4dd8017000 comp rx=0 tx=0).stop 2022-03-15T05:50:05.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 -- 172.21.15.151:0/3192182450 shutdown_connections 2022-03-15T05:50:05.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633c0 0x7f4dc4065870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:05.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de8155bc0 0x7f4de814e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:05.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de8152fb0 0x7f4de80c51a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:05.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 --2- 172.21.15.151:0/3192182450 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de8155240 0x7f4de8165460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:05.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 -- 172.21.15.151:0/3192182450 >> 172.21.15.151:0/3192182450 conn(0x7f4de806aa60 msgr2=0x7f4de8149fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:05.268 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 -- 172.21.15.151:0/3192182450 shutdown_connections 2022-03-15T05:50:05.268 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.263+0000 7f4dec80a700 1 -- 172.21.15.151:0/3192182450 wait complete. 2022-03-15T05:50:05.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2022-03-15T05:50:05.503 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.501+0000 7fcd52ca5700 1 Processor -- start 2022-03-15T05:50:05.503 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.501+0000 7fcd52ca5700 1 -- start start 2022-03-15T05:50:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.502+0000 7fcd52ca5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c066b40 0x7fcd4c06d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.502+0000 7fcd52ca5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd4c14ec70 0x7fcd4c06df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd52ca5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4c0c1500 con 0x7fcd4c06cd70 2022-03-15T05:50:05.505 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd52ca5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c06e970 con 0x7fcd4c14ec70 2022-03-15T05:50:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd52ca5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c06d560 con 0x7fcd4c066b40 2022-03-15T05:50:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd51242700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd4c14ec70 0x7fcd4c06df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd50a41700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c066b40 0x7fcd4c06d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:05.506 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd51242700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcd4c14ec70 0x7fcd4c06df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59986/0 (socket says 172.21.15.151:59986) 2022-03-15T05:50:05.507 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd51242700 1 -- 172.21.15.151:0/62060921 learned_addr learned my addr 172.21.15.151:0/62060921 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:05.507 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd4bfff700 1 --1- 172.21.15.151:0/62060921 >> v1:172.21.15.151:6789/0 conn(0x7fcd4c06cd70 0x7fcd4c14e560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53176/0 (socket says 172.21.15.151:53176) 2022-03-15T05:50:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd51242700 1 -- 172.21.15.151:0/62060921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c066b40 msgr2=0x7fcd4c06d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd51242700 1 --2- 172.21.15.151:0/62060921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c066b40 0x7fcd4c06d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd51242700 1 -- 172.21.15.151:0/62060921 >> v1:172.21.15.151:6789/0 conn(0x7fcd4c06cd70 legacy=0x7fcd4c14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:05.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd51242700 1 -- 172.21.15.151:0/62060921 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c1513b0 con 0x7fcd4c14ec70 2022-03-15T05:50:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.503+0000 7fcd50a41700 1 --2- 172.21.15.151:0/62060921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c066b40 0x7fcd4c06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.504+0000 7fcd51242700 1 --2- 172.21.15.151:0/62060921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c14ec70 0x7fcd4c06df30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009f20 tx=0x7fcd44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e53cfca578ed759e server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.504+0000 7fcd4b7fe700 1 -- 172.21.15.151:0/62060921 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd440092e0 con 0x7fcd4c14ec70 2022-03-15T05:50:05.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.504+0000 7fcd4b7fe700 1 -- 172.21.15.151:0/62060921 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4400b9d0 con 0x7fcd4c14ec70 2022-03-15T05:50:05.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.504+0000 7fcd4b7fe700 1 -- 172.21.15.151:0/62060921 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4400bd90 con 0x7fcd4c14ec70 2022-03-15T05:50:05.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.504+0000 7fcd52ca5700 1 -- 172.21.15.151:0/62060921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c14ec70 msgr2=0x7fcd4c06df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:05.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.504+0000 7fcd52ca5700 1 --2- 172.21.15.151:0/62060921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c14ec70 0x7fcd4c06df30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcd44009f20 tx=0x7fcd44009840 comp rx=0 tx=0).stop 2022-03-15T05:50:05.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.505+0000 7fcd52ca5700 1 -- 172.21.15.151:0/62060921 shutdown_connections 2022-03-15T05:50:05.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.505+0000 7fcd52ca5700 1 --2- 172.21.15.151:0/62060921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c14ec70 0x7fcd4c06df30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:05.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.505+0000 7fcd52ca5700 1 --2- 172.21.15.151:0/62060921 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c066b40 0x7fcd4c06d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:05.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.505+0000 7fcd52ca5700 1 -- 172.21.15.151:0/62060921 >> 172.21.15.151:0/62060921 conn(0x7fcd4c06aa60 msgr2=0x7fcd4c0c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:05.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.505+0000 7fcd52ca5700 1 -- 172.21.15.151:0/62060921 shutdown_connections 2022-03-15T05:50:05.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.505+0000 7fcd52ca5700 1 -- 172.21.15.151:0/62060921 wait complete. 2022-03-15T05:50:05.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.506+0000 7fcd52ca5700 1 Processor -- start 2022-03-15T05:50:05.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.506+0000 7fcd52ca5700 1 -- start start 2022-03-15T05:50:05.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.507+0000 7fcd52ca5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c066b40 0x7fcd4c0c01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:05.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.507+0000 7fcd52ca5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c06cd70 0x7fcd4c0bbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:05.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.507+0000 7fcd52ca5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c14ec70 0x7fcd4c0bc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:05.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.507+0000 7fcd52ca5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c0c64a0 con 0x7fcd4c066b40 2022-03-15T05:50:05.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.507+0000 7fcd52ca5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c0bb700 con 0x7fcd4c14ec70 2022-03-15T05:50:05.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.507+0000 7fcd52ca5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c0c7a80 con 0x7fcd4c06cd70 2022-03-15T05:50:05.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd50a41700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c066b40 0x7fcd4c0c01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:05.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd50a41700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c066b40 0x7fcd4c0c01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59988/0 (socket says 172.21.15.151:59988) 2022-03-15T05:50:05.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd50a41700 1 -- 172.21.15.151:0/3022535145 learned_addr learned my addr 172.21.15.151:0/3022535145 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:05.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd4bfff700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c06cd70 0x7fcd4c0bbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:05.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd51242700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c14ec70 0x7fcd4c0bc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:05.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd50a41700 1 -- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c06cd70 msgr2=0x7fcd4c0bbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:05.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd50a41700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c06cd70 0x7fcd4c0bbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:05.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd50a41700 1 -- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c14ec70 msgr2=0x7fcd4c0bc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:05.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd50a41700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c14ec70 0x7fcd4c0bc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:05.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd50a41700 1 -- 172.21.15.151:0/3022535145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400092a0 con 0x7fcd4c066b40 2022-03-15T05:50:05.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.508+0000 7fcd50a41700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c066b40 0x7fcd4c0c01d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000ea20 tx=0x7fcd40009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:05.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.509+0000 7fcd48ff9700 1 -- 172.21.15.151:0/3022535145 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd40009600 con 0x7fcd4c066b40 2022-03-15T05:50:05.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.509+0000 7fcd48ff9700 1 -- 172.21.15.151:0/3022535145 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4000c850 con 0x7fcd4c066b40 2022-03-15T05:50:05.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.509+0000 7fcd52ca5700 1 -- 172.21.15.151:0/3022535145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd44009ae0 con 0x7fcd4c066b40 2022-03-15T05:50:05.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.509+0000 7fcd48ff9700 1 -- 172.21.15.151:0/3022535145 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4000cbf0 con 0x7fcd4c066b40 2022-03-15T05:50:05.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.509+0000 7fcd52ca5700 1 -- 172.21.15.151:0/3022535145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c0c6920 con 0x7fcd4c066b40 2022-03-15T05:50:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.510+0000 7fcd52ca5700 1 -- 172.21.15.151:0/3022535145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c152070 con 0x7fcd4c066b40 2022-03-15T05:50:05.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.511+0000 7fcd48ff9700 1 -- 172.21.15.151:0/3022535145 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fcd40019030 con 0x7fcd4c066b40 2022-03-15T05:50:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.512+0000 7fcd48ff9700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcd340633c0 0x7fcd34065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.512+0000 7fcd48ff9700 1 -- 172.21.15.151:0/3022535145 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcd4007fcf0 con 0x7fcd4c066b40 2022-03-15T05:50:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.512+0000 7fcd4bfff700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcd340633c0 0x7fcd34065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:05.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.513+0000 7fcd4bfff700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcd340633c0 0x7fcd34065870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c15c890 tx=0x7fcd38007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:05.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.516+0000 7fcd48ff9700 1 -- 172.21.15.151:0/3022535145 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fcd4004ec90 con 0x7fcd4c066b40 2022-03-15T05:50:05.744 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:05.742+0000 7fcd52ca5700 1 -- 172.21.15.151:0/3022535145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcd4c04b760 con 0x7fcd4c066b40 2022-03-15T05:50:06.650 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.648+0000 7fcd48ff9700 1 -- 172.21.15.151:0/3022535145 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcd400522b0 con 0x7fcd4c066b40 2022-03-15T05:50:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 -- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcd340633c0 msgr2=0x7fcd34065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:06.654 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcd340633c0 0x7fcd34065870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c15c890 tx=0x7fcd38007d30 comp rx=0 tx=0).stop 2022-03-15T05:50:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 -- 172.21.15.151:0/3022535145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c066b40 msgr2=0x7fcd4c0c01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c066b40 0x7fcd4c0c01d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcd4000ea20 tx=0x7fcd40009060 comp rx=0 tx=0).stop 2022-03-15T05:50:06.655 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 -- 172.21.15.151:0/3022535145 shutdown_connections 2022-03-15T05:50:06.656 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcd340633c0 0x7fcd34065870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.656 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcd4c14ec70 0x7fcd4c0bc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.656 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4c066b40 0x7fcd4c0c01d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.657 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 --2- 172.21.15.151:0/3022535145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcd4c06cd70 0x7fcd4c0bbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.657 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 -- 172.21.15.151:0/3022535145 >> 172.21.15.151:0/3022535145 conn(0x7fcd4c06aa60 msgr2=0x7fcd4c0b8350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:06.657 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 -- 172.21.15.151:0/3022535145 shutdown_connections 2022-03-15T05:50:06.657 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.651+0000 7fcd52ca5700 1 -- 172.21.15.151:0/3022535145 wait complete. 2022-03-15T05:50:06.680 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2022-03-15T05:50:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.891+0000 7fe5ecb3a700 1 Processor -- start 2022-03-15T05:50:06.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.891+0000 7fe5ecb3a700 1 -- start start 2022-03-15T05:50:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.892+0000 7fe5ecb3a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe5e8155240 0x7fe5e8155610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.892+0000 7fe5ecb3a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e8152fb0 0x7fe5e80c2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.892+0000 7fe5ecb3a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe5e8155bc0 0x7fe5e80ba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:06.896 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.892+0000 7fe5ecb3a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e80c3100 con 0x7fe5e8155240 2022-03-15T05:50:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.892+0000 7fe5ecb3a700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5e80c1840 con 0x7fe5e8155bc0 2022-03-15T05:50:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.892+0000 7fe5ecb3a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80c1b20 con 0x7fe5e8152fb0 2022-03-15T05:50:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.893+0000 7fe5e659c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe5e8155240 0x7fe5e8155610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.893+0000 7fe5e659c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe5e8155240 0x7fe5e8155610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59990/0 (socket says 172.21.15.151:59990) 2022-03-15T05:50:06.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.893+0000 7fe5e659c700 1 -- 172.21.15.151:0/3133424647 learned_addr learned my addr 172.21.15.151:0/3133424647 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.893+0000 7fe5e6d9d700 1 --2- 172.21.15.151:0/3133424647 >> v2:172.21.15.164:3300/0 conn(0x7fe5e8155bc0 0x7fe5e80ba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.893+0000 7fe5e5d9b700 1 --2- 172.21.15.151:0/3133424647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e8152fb0 0x7fe5e80c2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.893+0000 7fe5e659c700 1 -- 172.21.15.151:0/3133424647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e8152fb0 msgr2=0x7fe5e80c2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.893+0000 7fe5e659c700 1 --2- 172.21.15.151:0/3133424647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e8152fb0 0x7fe5e80c2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.893+0000 7fe5e659c700 1 -- 172.21.15.151:0/3133424647 >> v2:172.21.15.164:3300/0 conn(0x7fe5e8155bc0 msgr2=0x7fe5e80ba1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.893+0000 7fe5e659c700 1 --2- 172.21.15.151:0/3133424647 >> v2:172.21.15.164:3300/0 conn(0x7fe5e8155bc0 0x7fe5e80ba1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.893+0000 7fe5e659c700 1 -- 172.21.15.151:0/3133424647 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e80c1e00 con 0x7fe5e8155240 2022-03-15T05:50:06.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5e659c700 1 --2- 172.21.15.151:0/3133424647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 0x7fe5e8155610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80c6c00 tx=0x7fe5d800b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5378a2c4ddb07f server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:06.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5e559a700 1 -- 172.21.15.151:0/3133424647 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8004030 con 0x7fe5e8155240 2022-03-15T05:50:06.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5e559a700 1 -- 172.21.15.151:0/3133424647 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5d8004190 con 0x7fe5e8155240 2022-03-15T05:50:06.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5e559a700 1 -- 172.21.15.151:0/3133424647 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5d800da40 con 0x7fe5e8155240 2022-03-15T05:50:06.907 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/3133424647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 msgr2=0x7fe5e8155610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:06.907 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5ecb3a700 1 --2- 172.21.15.151:0/3133424647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 0x7fe5e8155610 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80c6c00 tx=0x7fe5d800b3b0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.908 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/3133424647 shutdown_connections 2022-03-15T05:50:06.908 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5ecb3a700 1 --2- 172.21.15.151:0/3133424647 >> v2:172.21.15.164:3300/0 conn(0x7fe5e8155bc0 0x7fe5e80ba1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.908 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5ecb3a700 1 --2- 172.21.15.151:0/3133424647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 0x7fe5e8155610 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.909 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5ecb3a700 1 --2- 172.21.15.151:0/3133424647 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e8152fb0 0x7fe5e80c2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.909 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.894+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/3133424647 >> 172.21.15.151:0/3133424647 conn(0x7fe5e806aa60 msgr2=0x7fe5e80c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:06.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.895+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/3133424647 shutdown_connections 2022-03-15T05:50:06.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.895+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/3133424647 wait complete. 2022-03-15T05:50:06.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.896+0000 7fe5ecb3a700 1 Processor -- start 2022-03-15T05:50:06.911 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.896+0000 7fe5ecb3a700 1 -- start start 2022-03-15T05:50:06.911 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.897+0000 7fe5ecb3a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e8152fb0 0x7fe5e8152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:06.912 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.897+0000 7fe5ecb3a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 0x7fe5e814f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:06.912 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.897+0000 7fe5ecb3a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e8155bc0 0x7fe5e80bc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:06.912 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.897+0000 7fe5ecb3a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8165380 con 0x7fe5e8155240 2022-03-15T05:50:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.897+0000 7fe5ecb3a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8150cd0 con 0x7fe5e8155bc0 2022-03-15T05:50:06.913 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.897+0000 7fe5ecb3a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e80c6660 con 0x7fe5e8152fb0 2022-03-15T05:50:06.914 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.897+0000 7fe5e5d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 0x7fe5e814f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:06.914 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.897+0000 7fe5e659c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e8152fb0 0x7fe5e8152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:06.914 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.897+0000 7fe5e5d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 0x7fe5e814f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59992/0 (socket says 172.21.15.151:59992) 2022-03-15T05:50:06.915 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.897+0000 7fe5e5d9b700 1 -- 172.21.15.151:0/4038575145 learned_addr learned my addr 172.21.15.151:0/4038575145 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:06.915 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.898+0000 7fe5e6d9d700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e8155bc0 0x7fe5e80bc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.898+0000 7fe5e5d9b700 1 -- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e8152fb0 msgr2=0x7fe5e8152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.898+0000 7fe5e5d9b700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e8152fb0 0x7fe5e8152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.916 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.898+0000 7fe5e5d9b700 1 -- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e8155bc0 msgr2=0x7fe5e80bc390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:06.917 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.898+0000 7fe5e5d9b700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e8155bc0 0x7fe5e80bc390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:06.917 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.898+0000 7fe5e5d9b700 1 -- 172.21.15.151:0/4038575145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5d800b610 con 0x7fe5e8155240 2022-03-15T05:50:06.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.898+0000 7fe5e5d9b700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 0x7fe5e814f7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00e960 tx=0x7fe5dc009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:06.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.898+0000 7fe5d67fc700 1 -- 172.21.15.151:0/4038575145 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc013680 con 0x7fe5e8155240 2022-03-15T05:50:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.899+0000 7fe5d67fc700 1 -- 172.21.15.151:0/4038575145 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5dc0137e0 con 0x7fe5e8155240 2022-03-15T05:50:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.899+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/4038575145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e80c63f0 con 0x7fe5e8155240 2022-03-15T05:50:06.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.899+0000 7fe5d67fc700 1 -- 172.21.15.151:0/4038575145 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5dc013b60 con 0x7fe5e8155240 2022-03-15T05:50:06.920 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.899+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/4038575145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e8164cc0 con 0x7fe5e8155240 2022-03-15T05:50:06.920 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.900+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/4038575145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e804b760 con 0x7fe5e8155240 2022-03-15T05:50:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.901+0000 7fe5d67fc700 1 -- 172.21.15.151:0/4038575145 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fe5dc019030 con 0x7fe5e8155240 2022-03-15T05:50:06.921 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.902+0000 7fe5d67fc700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe5c40633c0 0x7fe5c4065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:06.922 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.902+0000 7fe5d67fc700 1 -- 172.21.15.151:0/4038575145 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe5dc07fb60 con 0x7fe5e8155240 2022-03-15T05:50:06.922 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.902+0000 7fe5e659c700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe5c40633c0 0x7fe5c4065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:06.923 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.903+0000 7fe5e659c700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe5c40633c0 0x7fe5c4065870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800b3f0 tx=0x7fe5d801a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:06.923 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:06.906+0000 7fe5d67fc700 1 -- 172.21.15.151:0/4038575145 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fe5dc04ebf0 con 0x7fe5e8155240 2022-03-15T05:50:07.131 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.129+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/4038575145 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fe5e80c20e0 con 0x7fe5e8155240 2022-03-15T05:50:07.656 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.654+0000 7fe5d67fc700 1 -- 172.21.15.151:0/4038575145 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v8) v1 ==== 115+0+0 (secure 0 0 0) 0x7fe5dc052210 con 0x7fe5e8155240 2022-03-15T05:50:07.659 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe5c40633c0 msgr2=0x7fe5c4065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:07.660 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe5c40633c0 0x7fe5c4065870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800b3f0 tx=0x7fe5d801a000 comp rx=0 tx=0).stop 2022-03-15T05:50:07.660 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/4038575145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 msgr2=0x7fe5e814f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:07.660 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 0x7fe5e814f7f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00e960 tx=0x7fe5dc009060 comp rx=0 tx=0).stop 2022-03-15T05:50:07.660 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/4038575145 shutdown_connections 2022-03-15T05:50:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe5c40633c0 0x7fe5c4065870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe5e8155bc0 0x7fe5e80bc390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe5e8152fb0 0x7fe5e8152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:07.661 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 --2- 172.21.15.151:0/4038575145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5e8155240 0x7fe5e814f7f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:07.662 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/4038575145 >> 172.21.15.151:0/4038575145 conn(0x7fe5e806aa60 msgr2=0x7fe5e8066d40 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:07.662 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/4038575145 shutdown_connections 2022-03-15T05:50:07.662 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.657+0000 7fe5ecb3a700 1 -- 172.21.15.151:0/4038575145 wait complete. 2022-03-15T05:50:07.684 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-03-15T05:50:07.892 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.890+0000 7f5d12ebd700 1 Processor -- start 2022-03-15T05:50:07.892 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.890+0000 7f5d12ebd700 1 -- start start 2022-03-15T05:50:07.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.891+0000 7f5d12ebd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 0x7f5d0c155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.891+0000 7f5d12ebd700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0c0c24a0 con 0x7f5d0c0c2050 2022-03-15T05:50:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.891+0000 7f5d12ebd700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d0c158560 con 0x7f5d0c0c2b30 2022-03-15T05:50:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.891+0000 7f5d12ebd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c158840 con 0x7f5d0c0c56e0 2022-03-15T05:50:07.894 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.892+0000 7f5d11ebb700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f5d0c0c2b30 0x7f5d0c157d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33642/0 (socket says 172.21.15.151:33642) 2022-03-15T05:50:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.892+0000 7f5d11ebb700 1 -- 172.21.15.151:0/1269667720 learned_addr learned my addr 172.21.15.151:0/1269667720 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.892+0000 7f5d116ba700 1 --2- 172.21.15.151:0/1269667720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 0x7f5d0c155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:07.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.892+0000 7f5d126bc700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f5d0c0c2050 0x7f5d0c0c4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53178/0 (socket says 172.21.15.151:53178) 2022-03-15T05:50:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.892+0000 7f5d10eb9700 1 -- 172.21.15.151:0/1269667720 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484238228 0 0) 0x7f5d0c158560 con 0x7f5d0c0c2b30 2022-03-15T05:50:07.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.892+0000 7f5d10eb9700 1 -- 172.21.15.151:0/1269667720 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cf40033f0 con 0x7f5d0c0c2b30 2022-03-15T05:50:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.892+0000 7f5d10eb9700 1 -- 172.21.15.151:0/1269667720 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3486427710 0 0) 0x7f5d0c0c24a0 con 0x7f5d0c0c2050 2022-03-15T05:50:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.892+0000 7f5d116ba700 1 -- 172.21.15.151:0/1269667720 >> v1:172.21.15.164:6789/0 conn(0x7f5d0c0c2b30 legacy=0x7f5d0c157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:07.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.892+0000 7f5d116ba700 1 -- 172.21.15.151:0/1269667720 >> v1:172.21.15.151:6789/0 conn(0x7f5d0c0c2050 legacy=0x7f5d0c0c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.892+0000 7f5d116ba700 1 -- 172.21.15.151:0/1269667720 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d0c158b20 con 0x7f5d0c0c56e0 2022-03-15T05:50:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.893+0000 7f5d116ba700 1 --2- 172.21.15.151:0/1269667720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 0x7f5d0c155340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009790 tx=0x7f5cfc009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0214daff4654d53 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.893+0000 7f5d10eb9700 1 -- 172.21.15.151:0/1269667720 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc011630 con 0x7f5d0c0c56e0 2022-03-15T05:50:07.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.893+0000 7f5d10eb9700 1 -- 172.21.15.151:0/1269667720 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cfc011790 con 0x7f5d0c0c56e0 2022-03-15T05:50:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.893+0000 7f5d10eb9700 1 -- 172.21.15.151:0/1269667720 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cfc011b30 con 0x7f5d0c0c56e0 2022-03-15T05:50:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.893+0000 7f5d12ebd700 1 -- 172.21.15.151:0/1269667720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 msgr2=0x7f5d0c155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.893+0000 7f5d12ebd700 1 --2- 172.21.15.151:0/1269667720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 0x7f5d0c155340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc009790 tx=0x7f5cfc009060 comp rx=0 tx=0).stop 2022-03-15T05:50:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.893+0000 7f5d12ebd700 1 -- 172.21.15.151:0/1269667720 shutdown_connections 2022-03-15T05:50:07.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.893+0000 7f5d12ebd700 1 --2- 172.21.15.151:0/1269667720 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 0x7f5d0c155340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:07.901 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.893+0000 7f5d12ebd700 1 -- 172.21.15.151:0/1269667720 >> 172.21.15.151:0/1269667720 conn(0x7f5d0c0cae10 msgr2=0x7f5d0c0cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:07.901 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.894+0000 7f5d12ebd700 1 -- 172.21.15.151:0/1269667720 shutdown_connections 2022-03-15T05:50:07.901 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.894+0000 7f5d12ebd700 1 -- 172.21.15.151:0/1269667720 wait complete. 2022-03-15T05:50:07.901 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.895+0000 7f5d12ebd700 1 Processor -- start 2022-03-15T05:50:07.902 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.895+0000 7f5d12ebd700 1 -- start start 2022-03-15T05:50:07.904 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.896+0000 7f5d12ebd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d0c0c2050 0x7f5d0c168590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:07.905 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.896+0000 7f5d12ebd700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d0c0c2b30 0x7f5d0c0ca340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:07.905 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.896+0000 7f5d12ebd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 0x7f5d0c0ca880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:07.905 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.896+0000 7f5d12ebd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c164830 con 0x7f5d0c0c2050 2022-03-15T05:50:07.905 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.896+0000 7f5d12ebd700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c168ad0 con 0x7f5d0c0c2b30 2022-03-15T05:50:07.906 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.896+0000 7f5d12ebd700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0c1535e0 con 0x7f5d0c0c56e0 2022-03-15T05:50:07.906 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.896+0000 7f5d11ebb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d0c0c2050 0x7f5d0c168590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:07.906 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d116ba700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d0c0c2b30 0x7f5d0c0ca340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:07.906 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d11ebb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d0c0c2050 0x7f5d0c168590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59996/0 (socket says 172.21.15.151:59996) 2022-03-15T05:50:07.907 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d11ebb700 1 -- 172.21.15.151:0/2448179869 learned_addr learned my addr 172.21.15.151:0/2448179869 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:07.907 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d116ba700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d0c0c2b30 0x7f5d0c0ca340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57214/0 (socket says 172.21.15.151:57214) 2022-03-15T05:50:07.907 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d126bc700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 0x7f5d0c0ca880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:07.907 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d11ebb700 1 -- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 msgr2=0x7f5d0c0ca880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:07.908 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d11ebb700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 0x7f5d0c0ca880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:07.908 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d11ebb700 1 -- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d0c0c2b30 msgr2=0x7f5d0c0ca340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:07.908 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d11ebb700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d0c0c2b30 0x7f5d0c0ca340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:07.908 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d11ebb700 1 -- 172.21.15.151:0/2448179869 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cfc0092a0 con 0x7f5d0c0c2050 2022-03-15T05:50:07.908 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5d11ebb700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d0c0c2050 0x7f5d0c168590 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800c410 tx=0x7f5d08007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:07.909 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.897+0000 7f5cf9ffb700 1 -- 172.21.15.151:0/2448179869 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d080070d0 con 0x7f5d0c0c2050 2022-03-15T05:50:07.909 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.898+0000 7f5cf9ffb700 1 -- 172.21.15.151:0/2448179869 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d08007270 con 0x7f5d0c0c2050 2022-03-15T05:50:07.909 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.898+0000 7f5d12ebd700 1 -- 172.21.15.151:0/2448179869 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0c0a8420 con 0x7f5d0c0c2050 2022-03-15T05:50:07.909 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.898+0000 7f5cf9ffb700 1 -- 172.21.15.151:0/2448179869 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d08007630 con 0x7f5d0c0c2050 2022-03-15T05:50:07.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.898+0000 7f5d12ebd700 1 -- 172.21.15.151:0/2448179869 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0c0a89e0 con 0x7f5d0c0c2050 2022-03-15T05:50:07.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.899+0000 7f5d12ebd700 1 -- 172.21.15.151:0/2448179869 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d0c0637b0 con 0x7f5d0c0c2050 2022-03-15T05:50:07.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.900+0000 7f5cf9ffb700 1 -- 172.21.15.151:0/2448179869 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f5d08019030 con 0x7f5d0c0c2050 2022-03-15T05:50:07.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.900+0000 7f5cf9ffb700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5cec0633c0 0x7f5cec065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:07.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.901+0000 7f5cf9ffb700 1 -- 172.21.15.151:0/2448179869 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5d0807ecf0 con 0x7f5d0c0c2050 2022-03-15T05:50:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.901+0000 7f5d116ba700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5cec0633c0 0x7f5cec065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.902+0000 7f5d116ba700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5cec0633c0 0x7f5cec065870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0096e0 tx=0x7f5cfc017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:07.911 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:07.905+0000 7f5cf9ffb700 1 -- 172.21.15.151:0/2448179869 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f5d08048ac0 con 0x7f5d0c0c2050 2022-03-15T05:50:08.135 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.133+0000 7f5d12ebd700 1 -- 172.21.15.151:0/2448179869 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5d0c154860 con 0x7f5d0c0c2050 2022-03-15T05:50:08.136 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.134+0000 7f5cf9ffb700 1 -- 172.21.15.151:0/2448179869 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6135 (secure 0 0 0) 0x7f5d08017070 con 0x7f5d0c0c2050 2022-03-15T05:50:08.136 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:08.137 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1733346300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1733346300},{"type":"v1","addr":"172.21.15.164:6836","nonce":1733346300}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2036596705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6837","nonce":2036596705},{"type":"v1","addr":"172.21.15.164:6839","nonce":2036596705}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3829445475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3829445475},{"type":"v1","addr":"172.21.15.151:6834","nonce":3829445475}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4284,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/745076217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":745076217},{"type":"v1","addr":"172.21.15.151:6837","nonce":745076217}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-03-15T05:50:02.249169+0000","modified":"2022-03-15T05:50:07.655092+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4312,"mds_1":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.164:6838/4178735378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":4178735378},{"type":"v1","addr":"172.21.15.164:6838","nonce":4178735378}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4312":{"gid":4312,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/3891906240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3891906240},{"type":"v1","addr":"172.21.15.151:6835","nonce":3891906240}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-03-15T05:50:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.136+0000 7f5d12ebd700 1 -- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5cec0633c0 msgr2=0x7f5cec065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.136+0000 7f5d12ebd700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5cec0633c0 0x7f5cec065870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5cfc0096e0 tx=0x7f5cfc017000 comp rx=0 tx=0).stop 2022-03-15T05:50:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.136+0000 7f5d12ebd700 1 -- 172.21.15.151:0/2448179869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d0c0c2050 msgr2=0x7f5d0c168590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.136+0000 7f5d12ebd700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d0c0c2050 0x7f5d0c168590 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800c410 tx=0x7f5d08007c70 comp rx=0 tx=0).stop 2022-03-15T05:50:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.137+0000 7f5d12ebd700 1 -- 172.21.15.151:0/2448179869 shutdown_connections 2022-03-15T05:50:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.137+0000 7f5d12ebd700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5cec0633c0 0x7f5cec065870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.137+0000 7f5d12ebd700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5d0c0c56e0 0x7f5d0c0ca880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.137+0000 7f5d12ebd700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5d0c0c2050 0x7f5d0c168590 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.137+0000 7f5d12ebd700 1 --2- 172.21.15.151:0/2448179869 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5d0c0c2b30 0x7f5d0c0ca340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.137+0000 7f5d12ebd700 1 -- 172.21.15.151:0/2448179869 >> 172.21.15.151:0/2448179869 conn(0x7f5d0c0cae10 msgr2=0x7f5d0c0679d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.137+0000 7f5d12ebd700 1 -- 172.21.15.151:0/2448179869 shutdown_connections 2022-03-15T05:50:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.137+0000 7f5d12ebd700 1 -- 172.21.15.151:0/2448179869 wait complete. 2022-03-15T05:50:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 9 2022-03-15T05:50:08.164 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-15T05:50:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.368+0000 7f7632b80700 1 Processor -- start 2022-03-15T05:50:08.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.368+0000 7f7632b80700 1 -- start start 2022-03-15T05:50:08.375 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f7632b80700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f762c0cb1f0 0x7f762c0c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.376 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f7632b80700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f762c155cf0 0x7f762c0c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.376 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f7632b80700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f762c0c27b0 con 0x7f762c0cb5c0 2022-03-15T05:50:08.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f7632b80700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c156170 con 0x7f762c155cf0 2022-03-15T05:50:08.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f7632b80700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c0c4f90 con 0x7f762c0cb1f0 2022-03-15T05:50:08.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f763111d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f762c155cf0 0x7f762c0c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f763111d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f762c155cf0 0x7f762c0c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59998/0 (socket says 172.21.15.151:59998) 2022-03-15T05:50:08.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f763111d700 1 -- 172.21.15.151:0/1323155698 learned_addr learned my addr 172.21.15.151:0/1323155698 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:08.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f763091c700 1 --2- 172.21.15.151:0/1323155698 >> v2:172.21.15.164:3300/0 conn(0x7f762c0cb1f0 0x7f762c0c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f763111d700 1 -- 172.21.15.151:0/1323155698 >> v2:172.21.15.164:3300/0 conn(0x7f762c0cb1f0 msgr2=0x7f762c0c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:08.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f763111d700 1 --2- 172.21.15.151:0/1323155698 >> v2:172.21.15.164:3300/0 conn(0x7f762c0cb1f0 0x7f762c0c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f763111d700 1 -- 172.21.15.151:0/1323155698 >> v1:172.21.15.164:6789/0 conn(0x7f762c0cb5c0 legacy=0x7f762c1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.370+0000 7f763111d700 1 -- 172.21.15.151:0/1323155698 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c0c5270 con 0x7f762c155cf0 2022-03-15T05:50:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.371+0000 7f763111d700 1 --2- 172.21.15.151:0/1323155698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c155cf0 0x7f762c0c58e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f762c088f70 tx=0x7f7624009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c0595caf5469943 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.371+0000 7f762b7fe700 1 -- 172.21.15.151:0/1323155698 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762400e070 con 0x7f762c155cf0 2022-03-15T05:50:08.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.371+0000 7f762b7fe700 1 -- 172.21.15.151:0/1323155698 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f762400ba20 con 0x7f762c155cf0 2022-03-15T05:50:08.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.371+0000 7f762b7fe700 1 -- 172.21.15.151:0/1323155698 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76240092e0 con 0x7f762c155cf0 2022-03-15T05:50:08.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.371+0000 7f7632b80700 1 -- 172.21.15.151:0/1323155698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c155cf0 msgr2=0x7f762c0c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.371+0000 7f7632b80700 1 --2- 172.21.15.151:0/1323155698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c155cf0 0x7f762c0c58e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f762c088f70 tx=0x7f7624009840 comp rx=0 tx=0).stop 2022-03-15T05:50:08.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.371+0000 7f7632b80700 1 -- 172.21.15.151:0/1323155698 shutdown_connections 2022-03-15T05:50:08.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.371+0000 7f7632b80700 1 --2- 172.21.15.151:0/1323155698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c155cf0 0x7f762c0c58e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.371+0000 7f7632b80700 1 --2- 172.21.15.151:0/1323155698 >> v2:172.21.15.164:3300/0 conn(0x7f762c0cb1f0 0x7f762c0c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.371+0000 7f7632b80700 1 -- 172.21.15.151:0/1323155698 >> 172.21.15.151:0/1323155698 conn(0x7f762c068e90 msgr2=0x7f762c069290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:08.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.372+0000 7f7632b80700 1 -- 172.21.15.151:0/1323155698 shutdown_connections 2022-03-15T05:50:08.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.372+0000 7f7632b80700 1 -- 172.21.15.151:0/1323155698 wait complete. 2022-03-15T05:50:08.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.373+0000 7f7632b80700 1 Processor -- start 2022-03-15T05:50:08.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.373+0000 7f7632b80700 1 -- start start 2022-03-15T05:50:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.374+0000 7f7632b80700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c0cb1f0 0x7f762c0c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.374+0000 7f7632b80700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f762c0cb5c0 0x7f762c0c9640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.374+0000 7f7632b80700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f762c155cf0 0x7f762c1585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.374+0000 7f7632b80700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0ca1e0 con 0x7f762c0cb1f0 2022-03-15T05:50:08.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.374+0000 7f7632b80700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0c91b0 con 0x7f762c155cf0 2022-03-15T05:50:08.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.374+0000 7f7632b80700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0ca410 con 0x7f762c0cb5c0 2022-03-15T05:50:08.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.374+0000 7f763091c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c0cb1f0 0x7f762c0c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.375+0000 7f763091c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c0cb1f0 0x7f762c0c7d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60000/0 (socket says 172.21.15.151:60000) 2022-03-15T05:50:08.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.375+0000 7f763091c700 1 -- 172.21.15.151:0/1769732707 learned_addr learned my addr 172.21.15.151:0/1769732707 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:08.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.375+0000 7f762bfff700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f762c0cb5c0 0x7f762c0c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.375+0000 7f763111d700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f762c155cf0 0x7f762c1585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.375+0000 7f763091c700 1 -- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f762c0cb5c0 msgr2=0x7f762c0c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.375+0000 7f763091c700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f762c0cb5c0 0x7f762c0c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.375+0000 7f763091c700 1 -- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f762c155cf0 msgr2=0x7f762c1585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.375+0000 7f763091c700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f762c155cf0 0x7f762c1585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.375+0000 7f763091c700 1 -- 172.21.15.151:0/1769732707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7624009ae0 con 0x7f762c0cb1f0 2022-03-15T05:50:08.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.375+0000 7f763091c700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c0cb1f0 0x7f762c0c7d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f762000e900 tx=0x7f7620009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.376+0000 7f7628ff9700 1 -- 172.21.15.151:0/1769732707 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620013680 con 0x7f762c0cb1f0 2022-03-15T05:50:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.376+0000 7f7628ff9700 1 -- 172.21.15.151:0/1769732707 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76200137e0 con 0x7f762c0cb1f0 2022-03-15T05:50:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.376+0000 7f7628ff9700 1 -- 172.21.15.151:0/1769732707 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620013b60 con 0x7f762c0cb1f0 2022-03-15T05:50:08.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.376+0000 7f7632b80700 1 -- 172.21.15.151:0/1769732707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c0ca6f0 con 0x7f762c0cb1f0 2022-03-15T05:50:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.376+0000 7f7632b80700 1 -- 172.21.15.151:0/1769732707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c0cacb0 con 0x7f762c0cb1f0 2022-03-15T05:50:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.377+0000 7f7632b80700 1 -- 172.21.15.151:0/1769732707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c0700c0 con 0x7f762c0cb1f0 2022-03-15T05:50:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.378+0000 7f7628ff9700 1 -- 172.21.15.151:0/1769732707 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f7620019030 con 0x7f762c0cb1f0 2022-03-15T05:50:08.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.379+0000 7f7628ff9700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f76140633f0 0x7f76140658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.379+0000 7f7628ff9700 1 -- 172.21.15.151:0/1769732707 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f762007f9b0 con 0x7f762c0cb1f0 2022-03-15T05:50:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.379+0000 7f762bfff700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f76140633f0 0x7f76140658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.380+0000 7f762bfff700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f76140633f0 0x7f76140658a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f762c0bea10 tx=0x7f7618009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:08.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.383+0000 7f7628ff9700 1 -- 172.21.15.151:0/1769732707 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f762004ea40 con 0x7f762c0cb1f0 2022-03-15T05:50:08.567 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.565+0000 7f7632b80700 1 -- 172.21.15.151:0/1769732707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f762c088260 con 0x7f762c0cb1f0 2022-03-15T05:50:08.568 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.566+0000 7f7628ff9700 1 -- 172.21.15.151:0/1769732707 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16893 (secure 0 0 0) 0x7f7620052060 con 0x7f762c0cb1f0 2022-03-15T05:50:08.569 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:08.569 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":24,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:50:03.251425+0000","last_up_change":"2022-03-15T05:49:47.305366+0000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-03-15T05:49:46.741897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-03-15T05:49:54.617407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-15T05:49:59.845834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-15T05:50:01.249141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":35552},{"type":"v1","addr":"172.21.15.151:6801","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":35552},{"type":"v1","addr":"172.21.15.151:6803","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":35552},{"type":"v1","addr":"172.21.15.151:6807","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":35552},{"type":"v1","addr":"172.21.15.151:6805","nonce":35552}]},"public_addr":"172.21.15.151:6801/35552","cluster_addr":"172.21.15.151:6803/35552","heartbeat_back_addr":"172.21.15.151:6807/35552","heartbeat_front_addr":"172.21.15.151:6805/35552","state":["exists","up"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":35554},{"type":"v1","addr":"172.21.15.151:6821","nonce":35554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":35554},{"type":"v1","addr":"172.21.15.151:6825","nonce":35554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":35554},{"type":"v1","addr":"172.21.15.151:6831","nonce":35554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":35554},{"type":"v1","addr":"172.21.15.151:6829","nonce":35554}]},"public_addr":"172.21.15.151:6821/35554","cluster_addr":"172.21.15.151:6825/35554","heartbeat_back_addr":"172.21.15.151:6831/35554","heartbeat_front_addr":"172.21.15.151:6829/35554","state":["exists","up"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":35555},{"type":"v1","addr":"172.21.15.151:6817","nonce":35555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":35555},{"type":"v1","addr":"172.21.15.151:6820","nonce":35555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":35555},{"type":"v1","addr":"172.21.15.151:6828","nonce":35555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":35555},{"type":"v1","addr":"172.21.15.151:6824","nonce":35555}]},"public_addr":"172.21.15.151:6817/35555","cluster_addr":"172.21.15.151:6820/35555","heartbeat_back_addr":"172.21.15.151:6828/35555","heartbeat_front_addr":"172.21.15.151:6824/35555","state":["exists","up"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":35553},{"type":"v1","addr":"172.21.15.151:6809","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":35553},{"type":"v1","addr":"172.21.15.151:6811","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":35553},{"type":"v1","addr":"172.21.15.151:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":35553},{"type":"v1","addr":"172.21.15.151:6813","nonce":35553}]},"public_addr":"172.21.15.151:6809/35553","cluster_addr":"172.21.15.151:6811/35553","heartbeat_back_addr":"172.21.15.151:6815/35553","heartbeat_front_addr":"172.21.15.151:6813/35553","state":["exists","up"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":41130},{"type":"v1","addr":"172.21.15.164:6825","nonce":41130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":41130},{"type":"v1","addr":"172.21.15.164:6827","nonce":41130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":41130},{"type":"v1","addr":"172.21.15.164:6831","nonce":41130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":41130},{"type":"v1","addr":"172.21.15.164:6829","nonce":41130}]},"public_addr":"172.21.15.164:6825/41130","cluster_addr":"172.21.15.164:6827/41130","heartbeat_back_addr":"172.21.15.164:6831/41130","heartbeat_front_addr":"172.21.15.164:6829/41130","state":["exists","up"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":41119},{"type":"v1","addr":"172.21.15.164:6801","nonce":41119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":41119},{"type":"v1","addr":"172.21.15.164:6803","nonce":41119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":41119},{"type":"v1","addr":"172.21.15.164:6807","nonce":41119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":41119},{"type":"v1","addr":"172.21.15.164:6805","nonce":41119}]},"public_addr":"172.21.15.164:6801/41119","cluster_addr":"172.21.15.164:6803/41119","heartbeat_back_addr":"172.21.15.164:6807/41119","heartbeat_front_addr":"172.21.15.164:6805/41119","state":["exists","up"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":41129},{"type":"v1","addr":"172.21.15.164:6817","nonce":41129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":41129},{"type":"v1","addr":"172.21.15.164:6819","nonce":41129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":41129},{"type":"v1","addr":"172.21.15.164:6823","nonce":41129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":41129},{"type":"v1","addr":"172.21.15.164:6821","nonce":41129}]},"public_addr":"172.21.15.164:6817/41129","cluster_addr":"172.21.15.164:6819/41129","heartbeat_back_addr":"172.21.15.164:6823/41129","heartbeat_front_addr":"172.21.15.164:6821/41129","state":["exists","up"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":41120},{"type":"v1","addr":"172.21.15.164:6809","nonce":41120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":41120},{"type":"v1","addr":"172.21.15.164:6811","nonce":41120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":41120},{"type":"v1","addr":"172.21.15.164:6816","nonce":41120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":41120},{"type":"v1","addr":"172.21.15.164:6813","nonce":41120}]},"public_addr":"172.21.15.164:6809/41120","cluster_addr":"172.21.15.164:6811/41120","heartbeat_back_addr":"172.21.15.164:6816/41120","heartbeat_front_addr":"172.21.15.164:6813/41120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.378836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.466901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.764352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.688587+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.304917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.236409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.231122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.208581+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:50:08.571 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.568+0000 7f7632b80700 1 -- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f76140633f0 msgr2=0x7f76140658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.571 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.568+0000 7f7632b80700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f76140633f0 0x7f76140658a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f762c0bea10 tx=0x7f7618009040 comp rx=0 tx=0).stop 2022-03-15T05:50:08.572 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.568+0000 7f7632b80700 1 -- 172.21.15.151:0/1769732707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c0cb1f0 msgr2=0x7f762c0c7d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.572 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.568+0000 7f7632b80700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c0cb1f0 0x7f762c0c7d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f762000e900 tx=0x7f7620009060 comp rx=0 tx=0).stop 2022-03-15T05:50:08.572 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.569+0000 7f7632b80700 1 -- 172.21.15.151:0/1769732707 shutdown_connections 2022-03-15T05:50:08.572 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.569+0000 7f7632b80700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f76140633f0 0x7f76140658a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.573 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.569+0000 7f7632b80700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f762c155cf0 0x7f762c1585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.573 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.569+0000 7f7632b80700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f762c0cb1f0 0x7f762c0c7d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.573 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.569+0000 7f7632b80700 1 --2- 172.21.15.151:0/1769732707 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f762c0cb5c0 0x7f762c0c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.573 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.569+0000 7f7632b80700 1 -- 172.21.15.151:0/1769732707 >> 172.21.15.151:0/1769732707 conn(0x7f762c068e90 msgr2=0x7f762c0bffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:08.574 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.569+0000 7f7632b80700 1 -- 172.21.15.151:0/1769732707 shutdown_connections 2022-03-15T05:50:08.574 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.569+0000 7f7632b80700 1 -- 172.21.15.151:0/1769732707 wait complete. 2022-03-15T05:50:08.595 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2022-03-15T05:50:08.596 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-03-15T05:50:08.804 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.802+0000 7ff6de1b2700 1 Processor -- start 2022-03-15T05:50:08.804 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.802+0000 7ff6de1b2700 1 -- start start 2022-03-15T05:50:08.805 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.803+0000 7ff6de1b2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff6d80c56e0 0x7ff6d8155340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.806 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.803+0000 7ff6de1b2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80c24d0 con 0x7ff6d80c2b30 2022-03-15T05:50:08.806 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.803+0000 7ff6de1b2700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d8158560 con 0x7ff6d80c2050 2022-03-15T05:50:08.806 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.803+0000 7ff6de1b2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d8158840 con 0x7ff6d80c56e0 2022-03-15T05:50:08.807 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.804+0000 7ff6dc9af700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff6d80c56e0 0x7ff6d8155340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.807 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.804+0000 7ff6dc9af700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff6d80c56e0 0x7ff6d8155340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60002/0 (socket says 172.21.15.151:60002) 2022-03-15T05:50:08.807 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.804+0000 7ff6dc9af700 1 -- 172.21.15.151:0/1460056773 learned_addr learned my addr 172.21.15.151:0/1460056773 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:08.807 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.804+0000 7ff6dd1b0700 1 --1- 172.21.15.151:0/1460056773 >> v1:172.21.15.151:6789/0 conn(0x7ff6d80c2b30 0x7ff6d8157d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53180/0 (socket says 172.21.15.151:53180) 2022-03-15T05:50:08.809 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.804+0000 7ff6dc9af700 1 -- 172.21.15.151:0/1460056773 >> v1:172.21.15.164:6789/0 conn(0x7ff6d80c2050 legacy=0x7ff6d80c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.809 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.804+0000 7ff6dc9af700 1 -- 172.21.15.151:0/1460056773 >> v1:172.21.15.151:6789/0 conn(0x7ff6d80c2b30 legacy=0x7ff6d8157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.810 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.804+0000 7ff6dc9af700 1 -- 172.21.15.151:0/1460056773 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d8158b20 con 0x7ff6d80c56e0 2022-03-15T05:50:08.810 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.804+0000 7ff6dc9af700 1 --2- 172.21.15.151:0/1460056773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c56e0 0x7ff6d8155340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8006fd0 tx=0x7ff6c80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6747a4e204170183 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:08.810 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.805+0000 7ff6c7fff700 1 -- 172.21.15.151:0/1460056773 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8004030 con 0x7ff6d80c56e0 2022-03-15T05:50:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.805+0000 7ff6c7fff700 1 -- 172.21.15.151:0/1460056773 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c80041b0 con 0x7ff6d80c56e0 2022-03-15T05:50:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.805+0000 7ff6c7fff700 1 -- 172.21.15.151:0/1460056773 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8011650 con 0x7ff6d80c56e0 2022-03-15T05:50:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.805+0000 7ff6de1b2700 1 -- 172.21.15.151:0/1460056773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c56e0 msgr2=0x7ff6d8155340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.811 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.805+0000 7ff6de1b2700 1 --2- 172.21.15.151:0/1460056773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c56e0 0x7ff6d8155340 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8006fd0 tx=0x7ff6c80090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.812 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.805+0000 7ff6de1b2700 1 -- 172.21.15.151:0/1460056773 shutdown_connections 2022-03-15T05:50:08.812 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.805+0000 7ff6de1b2700 1 --2- 172.21.15.151:0/1460056773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c56e0 0x7ff6d8155340 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.812 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.805+0000 7ff6de1b2700 1 -- 172.21.15.151:0/1460056773 >> 172.21.15.151:0/1460056773 conn(0x7ff6d80cae10 msgr2=0x7ff6d80cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:08.812 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.805+0000 7ff6de1b2700 1 -- 172.21.15.151:0/1460056773 shutdown_connections 2022-03-15T05:50:08.812 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.806+0000 7ff6de1b2700 1 -- 172.21.15.151:0/1460056773 wait complete. 2022-03-15T05:50:08.813 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.807+0000 7ff6de1b2700 1 Processor -- start 2022-03-15T05:50:08.813 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.807+0000 7ff6de1b2700 1 -- start start 2022-03-15T05:50:08.816 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.808+0000 7ff6de1b2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c2050 0x7ff6d80c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.816 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.808+0000 7ff6de1b2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6d80c2b30 0x7ff6d814e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.808+0000 7ff6de1b2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6d80c56e0 0x7ff6d814e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.808+0000 7ff6de1b2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80a74b0 con 0x7ff6d80c2050 2022-03-15T05:50:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.808+0000 7ff6de1b2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d81654c0 con 0x7ff6d80c2b30 2022-03-15T05:50:08.817 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.808+0000 7ff6de1b2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80a68a0 con 0x7ff6d80c56e0 2022-03-15T05:50:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.808+0000 7ff6dd1b0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c2050 0x7ff6d80c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.809+0000 7ff6dd1b0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c2050 0x7ff6d80c9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60006/0 (socket says 172.21.15.151:60006) 2022-03-15T05:50:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.809+0000 7ff6dd1b0700 1 -- 172.21.15.151:0/3977297684 learned_addr learned my addr 172.21.15.151:0/3977297684 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:08.818 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.809+0000 7ff6dc9af700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6d80c2b30 0x7ff6d814e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.819 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.809+0000 7ff6dd9b1700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6d80c56e0 0x7ff6d814e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.819 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.809+0000 7ff6dd1b0700 1 -- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6d80c56e0 msgr2=0x7ff6d814e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.819 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.809+0000 7ff6dd1b0700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6d80c56e0 0x7ff6d814e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.819 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.809+0000 7ff6dd1b0700 1 -- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6d80c2b30 msgr2=0x7ff6d814e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.809+0000 7ff6dd1b0700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6d80c2b30 0x7ff6d814e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.809+0000 7ff6dd1b0700 1 -- 172.21.15.151:0/3977297684 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c8009370 con 0x7ff6d80c2050 2022-03-15T05:50:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.809+0000 7ff6dd1b0700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c2050 0x7ff6d80c9e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4007fd0 tx=0x7ff6d4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.810+0000 7ff6c57fa700 1 -- 172.21.15.151:0/3977297684 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d400cea0 con 0x7ff6d80c2050 2022-03-15T05:50:08.820 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.810+0000 7ff6c57fa700 1 -- 172.21.15.151:0/3977297684 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d40072e0 con 0x7ff6d80c2050 2022-03-15T05:50:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.810+0000 7ff6c57fa700 1 -- 172.21.15.151:0/3977297684 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40046b0 con 0x7ff6d80c2050 2022-03-15T05:50:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.810+0000 7ff6de1b2700 1 -- 172.21.15.151:0/3977297684 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d80a6b80 con 0x7ff6d80c2050 2022-03-15T05:50:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.810+0000 7ff6de1b2700 1 -- 172.21.15.151:0/3977297684 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d80a7140 con 0x7ff6d80c2050 2022-03-15T05:50:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.811+0000 7ff6de1b2700 1 -- 172.21.15.151:0/3977297684 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d80637b0 con 0x7ff6d80c2050 2022-03-15T05:50:08.821 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.812+0000 7ff6c57fa700 1 -- 172.21.15.151:0/3977297684 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7ff6d4010070 con 0x7ff6d80c2050 2022-03-15T05:50:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.813+0000 7ff6c57fa700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff6b80633f0 0x7ff6b80658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.813+0000 7ff6c57fa700 1 -- 172.21.15.151:0/3977297684 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff6d407edc0 con 0x7ff6d80c2050 2022-03-15T05:50:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.813+0000 7ff6dc9af700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff6b80633f0 0x7ff6b80658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:08.822 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.814+0000 7ff6dc9af700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff6b80633f0 0x7ff6b80658a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8006fd0 tx=0x7ff6c8016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:08.823 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:08.816+0000 7ff6c57fa700 1 -- 172.21.15.151:0/3977297684 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7ff6d4048ac0 con 0x7ff6d80c2050 2022-03-15T05:50:09.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.002+0000 7ff6de1b2700 1 -- 172.21.15.151:0/3977297684 --> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff6d80a75f0 con 0x7ff6b80633f0 2022-03-15T05:50:09.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.011+0000 7ff6c57fa700 1 -- 172.21.15.151:0/3977297684 <== mgr.4111 v2:172.21.15.164:6832/40466 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278282 (secure 0 0 0) 0x7ff6c8004320 con 0x7ff6b80633f0 2022-03-15T05:50:09.017 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:09.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.015+0000 7ff6de1b2700 1 -- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff6b80633f0 msgr2=0x7ff6b80658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.015+0000 7ff6de1b2700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff6b80633f0 0x7ff6b80658a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8006fd0 tx=0x7ff6c8016000 comp rx=0 tx=0).stop 2022-03-15T05:50:09.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.015+0000 7ff6de1b2700 1 -- 172.21.15.151:0/3977297684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c2050 msgr2=0x7ff6d80c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.015+0000 7ff6de1b2700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c2050 0x7ff6d80c9e50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4007fd0 tx=0x7ff6d4007df0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.016+0000 7ff6de1b2700 1 -- 172.21.15.151:0/3977297684 shutdown_connections 2022-03-15T05:50:09.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.016+0000 7ff6de1b2700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff6b80633f0 0x7ff6b80658a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.016+0000 7ff6de1b2700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff6d80c56e0 0x7ff6d814e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.016+0000 7ff6de1b2700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d80c2050 0x7ff6d80c9e50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.016+0000 7ff6de1b2700 1 --2- 172.21.15.151:0/3977297684 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6d80c2b30 0x7ff6d814e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.016+0000 7ff6de1b2700 1 -- 172.21.15.151:0/3977297684 >> 172.21.15.151:0/3977297684 conn(0x7ff6d80cae10 msgr2=0x7ff6d8157930 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:09.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.016+0000 7ff6de1b2700 1 -- 172.21.15.151:0/3977297684 shutdown_connections 2022-03-15T05:50:09.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.016+0000 7ff6de1b2700 1 -- 172.21.15.151:0/3977297684 wait complete. 2022-03-15T05:50:09.023 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2022-03-15T05:50:09.042 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2022-03-15T05:50:08.650300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592020,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":65576,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":62528,"kb_avail":754909144,"statfs":{"total":773094113280,"available":773026963456,"internally_reserved":0,"allocated":3055616,"data_stored":1793450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64028672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.909722"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273754+0000","last_change":"2022-03-15T05:50:02.270526+0000","last_active":"2022-03-15T05:50:02.273754+0000","last_peered":"2022-03-15T05:50:02.273754+0000","last_clean":"2022-03-15T05:50:02.273754+0000","last_became_active":"2022-03-15T05:50:02.270047+0000","last_became_peered":"2022-03-15T05:50:02.270047+0000","last_unstale":"2022-03-15T05:50:02.273754+0000","last_undegraded":"2022-03-15T05:50:02.273754+0000","last_fullsized":"2022-03-15T05:50:02.273754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:19:07.916578+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275970+0000","last_change":"2022-03-15T05:50:02.272082+0000","last_active":"2022-03-15T05:50:02.275970+0000","last_peered":"2022-03-15T05:50:02.275970+0000","last_clean":"2022-03-15T05:50:02.275970+0000","last_became_active":"2022-03-15T05:50:02.271830+0000","last_became_peered":"2022-03-15T05:50:02.271830+0000","last_unstale":"2022-03-15T05:50:02.275970+0000","last_undegraded":"2022-03-15T05:50:02.275970+0000","last_fullsized":"2022-03-15T05:50:02.275970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:11:22.661539+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277940+0000","last_change":"2022-03-15T05:50:02.274527+0000","last_active":"2022-03-15T05:50:02.277940+0000","last_peered":"2022-03-15T05:50:02.277940+0000","last_clean":"2022-03-15T05:50:02.277940+0000","last_became_active":"2022-03-15T05:50:02.274276+0000","last_became_peered":"2022-03-15T05:50:02.274276+0000","last_unstale":"2022-03-15T05:50:02.277940+0000","last_undegraded":"2022-03-15T05:50:02.277940+0000","last_fullsized":"2022-03-15T05:50:02.277940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:30:36.811134+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278491+0000","last_change":"2022-03-15T05:50:02.273391+0000","last_active":"2022-03-15T05:50:02.278491+0000","last_peered":"2022-03-15T05:50:02.278491+0000","last_clean":"2022-03-15T05:50:02.278491+0000","last_became_active":"2022-03-15T05:50:02.273048+0000","last_became_peered":"2022-03-15T05:50:02.273048+0000","last_unstale":"2022-03-15T05:50:02.278491+0000","last_undegraded":"2022-03-15T05:50:02.278491+0000","last_fullsized":"2022-03-15T05:50:02.278491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:29:30.963367+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279283+0000","last_change":"2022-03-15T05:50:02.275876+0000","last_active":"2022-03-15T05:50:02.279283+0000","last_peered":"2022-03-15T05:50:02.279283+0000","last_clean":"2022-03-15T05:50:02.279283+0000","last_became_active":"2022-03-15T05:50:02.275568+0000","last_became_peered":"2022-03-15T05:50:02.275568+0000","last_unstale":"2022-03-15T05:50:02.279283+0000","last_undegraded":"2022-03-15T05:50:02.279283+0000","last_fullsized":"2022-03-15T05:50:02.279283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:49:14.636242+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285627+0000","last_change":"2022-03-15T05:50:02.280155+0000","last_active":"2022-03-15T05:50:02.285627+0000","last_peered":"2022-03-15T05:50:02.285627+0000","last_clean":"2022-03-15T05:50:02.285627+0000","last_became_active":"2022-03-15T05:50:02.279866+0000","last_became_peered":"2022-03-15T05:50:02.279866+0000","last_unstale":"2022-03-15T05:50:02.285627+0000","last_undegraded":"2022-03-15T05:50:02.285627+0000","last_fullsized":"2022-03-15T05:50:02.285627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:18:11.481888+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281731+0000","last_change":"2022-03-15T05:50:02.274634+0000","last_active":"2022-03-15T05:50:02.281731+0000","last_peered":"2022-03-15T05:50:02.281731+0000","last_clean":"2022-03-15T05:50:02.281731+0000","last_became_active":"2022-03-15T05:50:02.274365+0000","last_became_peered":"2022-03-15T05:50:02.274365+0000","last_unstale":"2022-03-15T05:50:02.281731+0000","last_undegraded":"2022-03-15T05:50:02.281731+0000","last_fullsized":"2022-03-15T05:50:02.281731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:30:21.663420+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286792+0000","last_change":"2022-03-15T05:50:02.285013+0000","last_active":"2022-03-15T05:50:02.286792+0000","last_peered":"2022-03-15T05:50:02.286792+0000","last_clean":"2022-03-15T05:50:02.286792+0000","last_became_active":"2022-03-15T05:50:02.284464+0000","last_became_peered":"2022-03-15T05:50:02.284464+0000","last_unstale":"2022-03-15T05:50:02.286792+0000","last_undegraded":"2022-03-15T05:50:02.286792+0000","last_fullsized":"2022-03-15T05:50:02.286792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:46:35.006614+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273371+0000","last_change":"2022-03-15T05:50:02.270735+0000","last_active":"2022-03-15T05:50:02.273371+0000","last_peered":"2022-03-15T05:50:02.273371+0000","last_clean":"2022-03-15T05:50:02.273371+0000","last_became_active":"2022-03-15T05:50:02.270318+0000","last_became_peered":"2022-03-15T05:50:02.270318+0000","last_unstale":"2022-03-15T05:50:02.273371+0000","last_undegraded":"2022-03-15T05:50:02.273371+0000","last_fullsized":"2022-03-15T05:50:02.273371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:12:33.142086+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278502+0000","last_change":"2022-03-15T05:50:02.273007+0000","last_active":"2022-03-15T05:50:02.278502+0000","last_peered":"2022-03-15T05:50:02.278502+0000","last_clean":"2022-03-15T05:50:02.278502+0000","last_became_active":"2022-03-15T05:50:02.272523+0000","last_became_peered":"2022-03-15T05:50:02.272523+0000","last_unstale":"2022-03-15T05:50:02.278502+0000","last_undegraded":"2022-03-15T05:50:02.278502+0000","last_fullsized":"2022-03-15T05:50:02.278502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:21:35.681401+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286135+0000","last_change":"2022-03-15T05:50:02.278777+0000","last_active":"2022-03-15T05:50:02.286135+0000","last_peered":"2022-03-15T05:50:02.286135+0000","last_clean":"2022-03-15T05:50:02.286135+0000","last_became_active":"2022-03-15T05:50:02.278500+0000","last_became_peered":"2022-03-15T05:50:02.278500+0000","last_unstale":"2022-03-15T05:50:02.286135+0000","last_undegraded":"2022-03-15T05:50:02.286135+0000","last_fullsized":"2022-03-15T05:50:02.286135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:38:10.301072+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284707+0000","last_change":"2022-03-15T05:50:02.283008+0000","last_active":"2022-03-15T05:50:02.284707+0000","last_peered":"2022-03-15T05:50:02.284707+0000","last_clean":"2022-03-15T05:50:02.284707+0000","last_became_active":"2022-03-15T05:50:02.282701+0000","last_became_peered":"2022-03-15T05:50:02.282701+0000","last_unstale":"2022-03-15T05:50:02.284707+0000","last_undegraded":"2022-03-15T05:50:02.284707+0000","last_fullsized":"2022-03-15T05:50:02.284707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:27:00.079571+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277381+0000","last_change":"2022-03-15T05:50:02.274545+0000","last_active":"2022-03-15T05:50:02.277381+0000","last_peered":"2022-03-15T05:50:02.277381+0000","last_clean":"2022-03-15T05:50:02.277381+0000","last_became_active":"2022-03-15T05:50:02.274210+0000","last_became_peered":"2022-03-15T05:50:02.274210+0000","last_unstale":"2022-03-15T05:50:02.277381+0000","last_undegraded":"2022-03-15T05:50:02.277381+0000","last_fullsized":"2022-03-15T05:50:02.277381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:56:38.005714+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282124+0000","last_change":"2022-03-15T05:50:02.276880+0000","last_active":"2022-03-15T05:50:02.282124+0000","last_peered":"2022-03-15T05:50:02.282124+0000","last_clean":"2022-03-15T05:50:02.282124+0000","last_became_active":"2022-03-15T05:50:02.276611+0000","last_became_peered":"2022-03-15T05:50:02.276611+0000","last_unstale":"2022-03-15T05:50:02.282124+0000","last_undegraded":"2022-03-15T05:50:02.282124+0000","last_fullsized":"2022-03-15T05:50:02.282124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:00:13.209564+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278683+0000","last_change":"2022-03-15T05:50:02.276997+0000","last_active":"2022-03-15T05:50:02.278683+0000","last_peered":"2022-03-15T05:50:02.278683+0000","last_clean":"2022-03-15T05:50:02.278683+0000","last_became_active":"2022-03-15T05:50:02.276696+0000","last_became_peered":"2022-03-15T05:50:02.276696+0000","last_unstale":"2022-03-15T05:50:02.278683+0000","last_undegraded":"2022-03-15T05:50:02.278683+0000","last_fullsized":"2022-03-15T05:50:02.278683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:00:32.831962+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281465+0000","last_change":"2022-03-15T05:50:02.269800+0000","last_active":"2022-03-15T05:50:02.281465+0000","last_peered":"2022-03-15T05:50:02.281465+0000","last_clean":"2022-03-15T05:50:02.281465+0000","last_became_active":"2022-03-15T05:50:02.269477+0000","last_became_peered":"2022-03-15T05:50:02.269477+0000","last_unstale":"2022-03-15T05:50:02.281465+0000","last_undegraded":"2022-03-15T05:50:02.281465+0000","last_fullsized":"2022-03-15T05:50:02.281465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:24:26.061545+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275881+0000","last_change":"2022-03-15T05:50:02.269504+0000","last_active":"2022-03-15T05:50:02.275881+0000","last_peered":"2022-03-15T05:50:02.275881+0000","last_clean":"2022-03-15T05:50:02.275881+0000","last_became_active":"2022-03-15T05:50:02.269199+0000","last_became_peered":"2022-03-15T05:50:02.269199+0000","last_unstale":"2022-03-15T05:50:02.275881+0000","last_undegraded":"2022-03-15T05:50:02.275881+0000","last_fullsized":"2022-03-15T05:50:02.275881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:48:27.314870+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280537+0000","last_change":"2022-03-15T05:50:02.271878+0000","last_active":"2022-03-15T05:50:02.280537+0000","last_peered":"2022-03-15T05:50:02.280537+0000","last_clean":"2022-03-15T05:50:02.280537+0000","last_became_active":"2022-03-15T05:50:02.271545+0000","last_became_peered":"2022-03-15T05:50:02.271545+0000","last_unstale":"2022-03-15T05:50:02.280537+0000","last_undegraded":"2022-03-15T05:50:02.280537+0000","last_fullsized":"2022-03-15T05:50:02.280537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:29:55.714092+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284711+0000","last_change":"2022-03-15T05:50:02.283062+0000","last_active":"2022-03-15T05:50:02.284711+0000","last_peered":"2022-03-15T05:50:02.284711+0000","last_clean":"2022-03-15T05:50:02.284711+0000","last_became_active":"2022-03-15T05:50:02.282688+0000","last_became_peered":"2022-03-15T05:50:02.282688+0000","last_unstale":"2022-03-15T05:50:02.284711+0000","last_undegraded":"2022-03-15T05:50:02.284711+0000","last_fullsized":"2022-03-15T05:50:02.284711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:28:47.117343+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.276419+0000","last_change":"2022-03-15T05:50:02.267259+0000","last_active":"2022-03-15T05:50:02.276419+0000","last_peered":"2022-03-15T05:50:02.276419+0000","last_clean":"2022-03-15T05:50:02.276419+0000","last_became_active":"2022-03-15T05:50:02.266987+0000","last_became_peered":"2022-03-15T05:50:02.266987+0000","last_unstale":"2022-03-15T05:50:02.276419+0000","last_undegraded":"2022-03-15T05:50:02.276419+0000","last_fullsized":"2022-03-15T05:50:02.276419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:58:11.812955+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280321+0000","last_change":"2022-03-15T05:50:02.276941+0000","last_active":"2022-03-15T05:50:02.280321+0000","last_peered":"2022-03-15T05:50:02.280321+0000","last_clean":"2022-03-15T05:50:02.280321+0000","last_became_active":"2022-03-15T05:50:02.276681+0000","last_became_peered":"2022-03-15T05:50:02.276681+0000","last_unstale":"2022-03-15T05:50:02.280321+0000","last_undegraded":"2022-03-15T05:50:02.280321+0000","last_fullsized":"2022-03-15T05:50:02.280321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:33:21.840005+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.269747+0000","last_change":"2022-03-15T05:50:02.269105+0000","last_active":"2022-03-15T05:50:02.269747+0000","last_peered":"2022-03-15T05:50:02.269747+0000","last_clean":"2022-03-15T05:50:02.269747+0000","last_became_active":"2022-03-15T05:50:02.268808+0000","last_became_peered":"2022-03-15T05:50:02.268808+0000","last_unstale":"2022-03-15T05:50:02.269747+0000","last_undegraded":"2022-03-15T05:50:02.269747+0000","last_fullsized":"2022-03-15T05:50:02.269747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:52:28.049853+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280638+0000","last_change":"2022-03-15T05:50:02.277497+0000","last_active":"2022-03-15T05:50:02.280638+0000","last_peered":"2022-03-15T05:50:02.280638+0000","last_clean":"2022-03-15T05:50:02.280638+0000","last_became_active":"2022-03-15T05:50:02.277184+0000","last_became_peered":"2022-03-15T05:50:02.277184+0000","last_unstale":"2022-03-15T05:50:02.280638+0000","last_undegraded":"2022-03-15T05:50:02.280638+0000","last_fullsized":"2022-03-15T05:50:02.280638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:35:31.460982+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280352+0000","last_change":"2022-03-15T05:50:02.277944+0000","last_active":"2022-03-15T05:50:02.280352+0000","last_peered":"2022-03-15T05:50:02.280352+0000","last_clean":"2022-03-15T05:50:02.280352+0000","last_became_active":"2022-03-15T05:50:02.277565+0000","last_became_peered":"2022-03-15T05:50:02.277565+0000","last_unstale":"2022-03-15T05:50:02.280352+0000","last_undegraded":"2022-03-15T05:50:02.280352+0000","last_fullsized":"2022-03-15T05:50:02.280352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:05:09.174014+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278568+0000","last_change":"2022-03-15T05:50:02.273042+0000","last_active":"2022-03-15T05:50:02.278568+0000","last_peered":"2022-03-15T05:50:02.278568+0000","last_clean":"2022-03-15T05:50:02.278568+0000","last_became_active":"2022-03-15T05:50:02.272528+0000","last_became_peered":"2022-03-15T05:50:02.272528+0000","last_unstale":"2022-03-15T05:50:02.278568+0000","last_undegraded":"2022-03-15T05:50:02.278568+0000","last_fullsized":"2022-03-15T05:50:02.278568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:38:32.868531+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278082+0000","last_change":"2022-03-15T05:50:02.270444+0000","last_active":"2022-03-15T05:50:02.278082+0000","last_peered":"2022-03-15T05:50:02.278082+0000","last_clean":"2022-03-15T05:50:02.278082+0000","last_became_active":"2022-03-15T05:50:02.270129+0000","last_became_peered":"2022-03-15T05:50:02.270129+0000","last_unstale":"2022-03-15T05:50:02.278082+0000","last_undegraded":"2022-03-15T05:50:02.278082+0000","last_fullsized":"2022-03-15T05:50:02.278082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:18:58.888559+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285050+0000","last_change":"2022-03-15T05:50:02.279990+0000","last_active":"2022-03-15T05:50:02.285050+0000","last_peered":"2022-03-15T05:50:02.285050+0000","last_clean":"2022-03-15T05:50:02.285050+0000","last_became_active":"2022-03-15T05:50:02.279527+0000","last_became_peered":"2022-03-15T05:50:02.279527+0000","last_unstale":"2022-03-15T05:50:02.285050+0000","last_undegraded":"2022-03-15T05:50:02.285050+0000","last_fullsized":"2022-03-15T05:50:02.285050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:10:41.298991+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267046+0000","last_change":"2022-03-15T05:50:01.757857+0000","last_active":"2022-03-15T05:50:02.267046+0000","last_peered":"2022-03-15T05:50:02.267046+0000","last_clean":"2022-03-15T05:50:02.267046+0000","last_became_active":"2022-03-15T05:50:01.757378+0000","last_became_peered":"2022-03-15T05:50:01.757378+0000","last_unstale":"2022-03-15T05:50:02.267046+0000","last_undegraded":"2022-03-15T05:50:02.267046+0000","last_fullsized":"2022-03-15T05:50:02.267046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:29:24.796802+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278203+0000","last_change":"2022-03-15T05:50:02.274309+0000","last_active":"2022-03-15T05:50:02.278203+0000","last_peered":"2022-03-15T05:50:02.278203+0000","last_clean":"2022-03-15T05:50:02.278203+0000","last_became_active":"2022-03-15T05:50:02.273944+0000","last_became_peered":"2022-03-15T05:50:02.273944+0000","last_unstale":"2022-03-15T05:50:02.278203+0000","last_undegraded":"2022-03-15T05:50:02.278203+0000","last_fullsized":"2022-03-15T05:50:02.278203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:31:34.056283+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263479+0000","last_change":"2022-03-15T05:50:01.761316+0000","last_active":"2022-03-15T05:50:02.263479+0000","last_peered":"2022-03-15T05:50:02.263479+0000","last_clean":"2022-03-15T05:50:02.263479+0000","last_became_active":"2022-03-15T05:50:01.761064+0000","last_became_peered":"2022-03-15T05:50:01.761064+0000","last_unstale":"2022-03-15T05:50:02.263479+0000","last_undegraded":"2022-03-15T05:50:02.263479+0000","last_fullsized":"2022-03-15T05:50:02.263479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:08:39.825646+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280915+0000","last_change":"2022-03-15T05:50:02.278164+0000","last_active":"2022-03-15T05:50:02.280915+0000","last_peered":"2022-03-15T05:50:02.280915+0000","last_clean":"2022-03-15T05:50:02.280915+0000","last_became_active":"2022-03-15T05:50:02.277785+0000","last_became_peered":"2022-03-15T05:50:02.277785+0000","last_unstale":"2022-03-15T05:50:02.280915+0000","last_undegraded":"2022-03-15T05:50:02.280915+0000","last_fullsized":"2022-03-15T05:50:02.280915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:55:34.060331+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266525+0000","last_change":"2022-03-15T05:50:01.756648+0000","last_active":"2022-03-15T05:50:02.266525+0000","last_peered":"2022-03-15T05:50:02.266525+0000","last_clean":"2022-03-15T05:50:02.266525+0000","last_became_active":"2022-03-15T05:50:01.755611+0000","last_became_peered":"2022-03-15T05:50:01.755611+0000","last_unstale":"2022-03-15T05:50:02.266525+0000","last_undegraded":"2022-03-15T05:50:02.266525+0000","last_fullsized":"2022-03-15T05:50:02.266525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:34:52.558274+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281413+0000","last_change":"2022-03-15T05:50:02.273665+0000","last_active":"2022-03-15T05:50:02.281413+0000","last_peered":"2022-03-15T05:50:02.281413+0000","last_clean":"2022-03-15T05:50:02.281413+0000","last_became_active":"2022-03-15T05:50:02.273305+0000","last_became_peered":"2022-03-15T05:50:02.273305+0000","last_unstale":"2022-03-15T05:50:02.281413+0000","last_undegraded":"2022-03-15T05:50:02.281413+0000","last_fullsized":"2022-03-15T05:50:02.281413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:09:21.723908+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.268432+0000","last_change":"2022-03-15T05:50:01.766117+0000","last_active":"2022-03-15T05:50:02.268432+0000","last_peered":"2022-03-15T05:50:02.268432+0000","last_clean":"2022-03-15T05:50:02.268432+0000","last_became_active":"2022-03-15T05:50:01.765787+0000","last_became_peered":"2022-03-15T05:50:01.765787+0000","last_unstale":"2022-03-15T05:50:02.268432+0000","last_undegraded":"2022-03-15T05:50:02.268432+0000","last_fullsized":"2022-03-15T05:50:02.268432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:01:30.570219+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282069+0000","last_change":"2022-03-15T05:50:02.281022+0000","last_active":"2022-03-15T05:50:02.282069+0000","last_peered":"2022-03-15T05:50:02.282069+0000","last_clean":"2022-03-15T05:50:02.282069+0000","last_became_active":"2022-03-15T05:50:02.280637+0000","last_became_peered":"2022-03-15T05:50:02.280637+0000","last_unstale":"2022-03-15T05:50:02.282069+0000","last_undegraded":"2022-03-15T05:50:02.282069+0000","last_fullsized":"2022-03-15T05:50:02.282069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:22:20.683447+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.257650+0000","last_change":"2022-03-15T05:50:01.761879+0000","last_active":"2022-03-15T05:50:02.257650+0000","last_peered":"2022-03-15T05:50:02.257650+0000","last_clean":"2022-03-15T05:50:02.257650+0000","last_became_active":"2022-03-15T05:50:01.761612+0000","last_became_peered":"2022-03-15T05:50:01.761612+0000","last_unstale":"2022-03-15T05:50:02.257650+0000","last_undegraded":"2022-03-15T05:50:02.257650+0000","last_fullsized":"2022-03-15T05:50:02.257650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:48:49.655032+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282022+0000","last_change":"2022-03-15T05:50:02.280735+0000","last_active":"2022-03-15T05:50:02.282022+0000","last_peered":"2022-03-15T05:50:02.282022+0000","last_clean":"2022-03-15T05:50:02.282022+0000","last_became_active":"2022-03-15T05:50:02.280417+0000","last_became_peered":"2022-03-15T05:50:02.280417+0000","last_unstale":"2022-03-15T05:50:02.282022+0000","last_undegraded":"2022-03-15T05:50:02.282022+0000","last_fullsized":"2022-03-15T05:50:02.282022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:02:09.355535+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.262913+0000","last_change":"2022-03-15T05:50:01.763468+0000","last_active":"2022-03-15T05:50:02.262913+0000","last_peered":"2022-03-15T05:50:02.262913+0000","last_clean":"2022-03-15T05:50:02.262913+0000","last_became_active":"2022-03-15T05:50:01.763046+0000","last_became_peered":"2022-03-15T05:50:01.763046+0000","last_unstale":"2022-03-15T05:50:02.262913+0000","last_undegraded":"2022-03-15T05:50:02.262913+0000","last_fullsized":"2022-03-15T05:50:02.262913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:02:04.856436+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.276334+0000","last_change":"2022-03-15T05:50:02.272492+0000","last_active":"2022-03-15T05:50:02.276334+0000","last_peered":"2022-03-15T05:50:02.276334+0000","last_clean":"2022-03-15T05:50:02.276334+0000","last_became_active":"2022-03-15T05:50:02.266942+0000","last_became_peered":"2022-03-15T05:50:02.266942+0000","last_unstale":"2022-03-15T05:50:02.276334+0000","last_undegraded":"2022-03-15T05:50:02.276334+0000","last_fullsized":"2022-03-15T05:50:02.276334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:48:30.216948+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.267260+0000","last_change":"2022-03-15T05:50:01.767583+0000","last_active":"2022-03-15T05:50:07.267260+0000","last_peered":"2022-03-15T05:50:07.267260+0000","last_clean":"2022-03-15T05:50:07.267260+0000","last_became_active":"2022-03-15T05:50:01.766773+0000","last_became_peered":"2022-03-15T05:50:01.766773+0000","last_unstale":"2022-03-15T05:50:07.267260+0000","last_undegraded":"2022-03-15T05:50:07.267260+0000","last_fullsized":"2022-03-15T05:50:07.267260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:23:44.248528+0000","stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278156+0000","last_change":"2022-03-15T05:50:02.271456+0000","last_active":"2022-03-15T05:50:02.278156+0000","last_peered":"2022-03-15T05:50:02.278156+0000","last_clean":"2022-03-15T05:50:02.278156+0000","last_became_active":"2022-03-15T05:50:02.270402+0000","last_became_peered":"2022-03-15T05:50:02.270402+0000","last_unstale":"2022-03-15T05:50:02.278156+0000","last_undegraded":"2022-03-15T05:50:02.278156+0000","last_fullsized":"2022-03-15T05:50:02.278156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:29:17.756689+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.265537+0000","last_change":"2022-03-15T05:50:01.768867+0000","last_active":"2022-03-15T05:50:07.265537+0000","last_peered":"2022-03-15T05:50:07.265537+0000","last_clean":"2022-03-15T05:50:07.265537+0000","last_became_active":"2022-03-15T05:50:01.768586+0000","last_became_peered":"2022-03-15T05:50:01.768586+0000","last_unstale":"2022-03-15T05:50:07.265537+0000","last_undegraded":"2022-03-15T05:50:07.265537+0000","last_fullsized":"2022-03-15T05:50:07.265537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:54:20.464304+0000","stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279217+0000","last_change":"2022-03-15T05:50:02.277330+0000","last_active":"2022-03-15T05:50:02.279217+0000","last_peered":"2022-03-15T05:50:02.279217+0000","last_clean":"2022-03-15T05:50:02.279217+0000","last_became_active":"2022-03-15T05:50:02.276873+0000","last_became_peered":"2022-03-15T05:50:02.276873+0000","last_unstale":"2022-03-15T05:50:02.279217+0000","last_undegraded":"2022-03-15T05:50:02.279217+0000","last_fullsized":"2022-03-15T05:50:02.279217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:24:11.044313+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266707+0000","last_change":"2022-03-15T05:50:01.768784+0000","last_active":"2022-03-15T05:50:02.266707+0000","last_peered":"2022-03-15T05:50:02.266707+0000","last_clean":"2022-03-15T05:50:02.266707+0000","last_became_active":"2022-03-15T05:50:01.768446+0000","last_became_peered":"2022-03-15T05:50:01.768446+0000","last_unstale":"2022-03-15T05:50:02.266707+0000","last_undegraded":"2022-03-15T05:50:02.266707+0000","last_fullsized":"2022-03-15T05:50:02.266707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:17:30.808770+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285030+0000","last_change":"2022-03-15T05:50:02.279791+0000","last_active":"2022-03-15T05:50:02.285030+0000","last_peered":"2022-03-15T05:50:02.285030+0000","last_clean":"2022-03-15T05:50:02.285030+0000","last_became_active":"2022-03-15T05:50:02.279172+0000","last_became_peered":"2022-03-15T05:50:02.279172+0000","last_unstale":"2022-03-15T05:50:02.285030+0000","last_undegraded":"2022-03-15T05:50:02.285030+0000","last_fullsized":"2022-03-15T05:50:02.285030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:06:01.717047+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261139+0000","last_change":"2022-03-15T05:50:01.765934+0000","last_active":"2022-03-15T05:50:02.261139+0000","last_peered":"2022-03-15T05:50:02.261139+0000","last_clean":"2022-03-15T05:50:02.261139+0000","last_became_active":"2022-03-15T05:50:01.765593+0000","last_became_peered":"2022-03-15T05:50:01.765593+0000","last_unstale":"2022-03-15T05:50:02.261139+0000","last_undegraded":"2022-03-15T05:50:02.261139+0000","last_fullsized":"2022-03-15T05:50:02.261139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:17:58.343945+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273584+0000","last_change":"2022-03-15T05:50:02.271214+0000","last_active":"2022-03-15T05:50:02.273584+0000","last_peered":"2022-03-15T05:50:02.273584+0000","last_clean":"2022-03-15T05:50:02.273584+0000","last_became_active":"2022-03-15T05:50:02.270503+0000","last_became_peered":"2022-03-15T05:50:02.270503+0000","last_unstale":"2022-03-15T05:50:02.273584+0000","last_undegraded":"2022-03-15T05:50:02.273584+0000","last_fullsized":"2022-03-15T05:50:02.273584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:46:34.707474+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261962+0000","last_change":"2022-03-15T05:50:01.760128+0000","last_active":"2022-03-15T05:50:02.261962+0000","last_peered":"2022-03-15T05:50:02.261962+0000","last_clean":"2022-03-15T05:50:02.261962+0000","last_became_active":"2022-03-15T05:50:01.759822+0000","last_became_peered":"2022-03-15T05:50:01.759822+0000","last_unstale":"2022-03-15T05:50:02.261962+0000","last_undegraded":"2022-03-15T05:50:02.261962+0000","last_fullsized":"2022-03-15T05:50:02.261962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:18:48.265357+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280983+0000","last_change":"2022-03-15T05:50:02.279712+0000","last_active":"2022-03-15T05:50:02.280983+0000","last_peered":"2022-03-15T05:50:02.280983+0000","last_clean":"2022-03-15T05:50:02.280983+0000","last_became_active":"2022-03-15T05:50:02.279212+0000","last_became_peered":"2022-03-15T05:50:02.279212+0000","last_unstale":"2022-03-15T05:50:02.280983+0000","last_undegraded":"2022-03-15T05:50:02.280983+0000","last_fullsized":"2022-03-15T05:50:02.280983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:19:44.101895+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.260222+0000","last_change":"2022-03-15T05:50:01.758101+0000","last_active":"2022-03-15T05:50:02.260222+0000","last_peered":"2022-03-15T05:50:02.260222+0000","last_clean":"2022-03-15T05:50:02.260222+0000","last_became_active":"2022-03-15T05:50:01.757825+0000","last_became_peered":"2022-03-15T05:50:01.757825+0000","last_unstale":"2022-03-15T05:50:02.260222+0000","last_undegraded":"2022-03-15T05:50:02.260222+0000","last_fullsized":"2022-03-15T05:50:02.260222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:17:42.303241+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281448+0000","last_change":"2022-03-15T05:50:02.267337+0000","last_active":"2022-03-15T05:50:02.281448+0000","last_peered":"2022-03-15T05:50:02.281448+0000","last_clean":"2022-03-15T05:50:02.281448+0000","last_became_active":"2022-03-15T05:50:02.267082+0000","last_became_peered":"2022-03-15T05:50:02.267082+0000","last_unstale":"2022-03-15T05:50:02.281448+0000","last_undegraded":"2022-03-15T05:50:02.281448+0000","last_fullsized":"2022-03-15T05:50:02.281448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:28:10.148060+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.265537+0000","last_change":"2022-03-15T05:50:01.766324+0000","last_active":"2022-03-15T05:50:07.265537+0000","last_peered":"2022-03-15T05:50:07.265537+0000","last_clean":"2022-03-15T05:50:07.265537+0000","last_became_active":"2022-03-15T05:50:01.766008+0000","last_became_peered":"2022-03-15T05:50:01.766008+0000","last_unstale":"2022-03-15T05:50:07.265537+0000","last_undegraded":"2022-03-15T05:50:07.265537+0000","last_fullsized":"2022-03-15T05:50:07.265537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:00:37.206705+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280289+0000","last_change":"2022-03-15T05:50:02.276334+0000","last_active":"2022-03-15T05:50:02.280289+0000","last_peered":"2022-03-15T05:50:02.280289+0000","last_clean":"2022-03-15T05:50:02.280289+0000","last_became_active":"2022-03-15T05:50:02.276030+0000","last_became_peered":"2022-03-15T05:50:02.276030+0000","last_unstale":"2022-03-15T05:50:02.280289+0000","last_undegraded":"2022-03-15T05:50:02.280289+0000","last_fullsized":"2022-03-15T05:50:02.280289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:24:56.245923+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:03.259992+0000","last_change":"2022-03-15T05:50:01.771270+0000","last_active":"2022-03-15T05:50:03.259992+0000","last_peered":"2022-03-15T05:50:03.259992+0000","last_clean":"2022-03-15T05:50:03.259992+0000","last_became_active":"2022-03-15T05:50:01.770985+0000","last_became_peered":"2022-03-15T05:50:01.770985+0000","last_unstale":"2022-03-15T05:50:03.259992+0000","last_undegraded":"2022-03-15T05:50:03.259992+0000","last_fullsized":"2022-03-15T05:50:03.259992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:28:26.138901+0000","stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277231+0000","last_change":"2022-03-15T05:50:02.270661+0000","last_active":"2022-03-15T05:50:02.277231+0000","last_peered":"2022-03-15T05:50:02.277231+0000","last_clean":"2022-03-15T05:50:02.277231+0000","last_became_active":"2022-03-15T05:50:02.270338+0000","last_became_peered":"2022-03-15T05:50:02.270338+0000","last_unstale":"2022-03-15T05:50:02.277231+0000","last_undegraded":"2022-03-15T05:50:02.277231+0000","last_fullsized":"2022-03-15T05:50:02.277231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:07:13.970018+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261651+0000","last_change":"2022-03-15T05:50:01.760891+0000","last_active":"2022-03-15T05:50:02.261651+0000","last_peered":"2022-03-15T05:50:02.261651+0000","last_clean":"2022-03-15T05:50:02.261651+0000","last_became_active":"2022-03-15T05:50:01.760552+0000","last_became_peered":"2022-03-15T05:50:01.760552+0000","last_unstale":"2022-03-15T05:50:02.261651+0000","last_undegraded":"2022-03-15T05:50:02.261651+0000","last_fullsized":"2022-03-15T05:50:02.261651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:10:36.649419+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278969+0000","last_change":"2022-03-15T05:50:02.277381+0000","last_active":"2022-03-15T05:50:02.278969+0000","last_peered":"2022-03-15T05:50:02.278969+0000","last_clean":"2022-03-15T05:50:02.278969+0000","last_became_active":"2022-03-15T05:50:02.277113+0000","last_became_peered":"2022-03-15T05:50:02.277113+0000","last_unstale":"2022-03-15T05:50:02.278969+0000","last_undegraded":"2022-03-15T05:50:02.278969+0000","last_fullsized":"2022-03-15T05:50:02.278969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:20:07.922465+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.258968+0000","last_change":"2022-03-15T05:50:01.757991+0000","last_active":"2022-03-15T05:50:02.258968+0000","last_peered":"2022-03-15T05:50:02.258968+0000","last_clean":"2022-03-15T05:50:02.258968+0000","last_became_active":"2022-03-15T05:50:01.757651+0000","last_became_peered":"2022-03-15T05:50:01.757651+0000","last_unstale":"2022-03-15T05:50:02.258968+0000","last_undegraded":"2022-03-15T05:50:02.258968+0000","last_fullsized":"2022-03-15T05:50:02.258968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:17:51.775038+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278650+0000","last_change":"2022-03-15T05:50:02.277017+0000","last_active":"2022-03-15T05:50:02.278650+0000","last_peered":"2022-03-15T05:50:02.278650+0000","last_clean":"2022-03-15T05:50:02.278650+0000","last_became_active":"2022-03-15T05:50:02.276718+0000","last_became_peered":"2022-03-15T05:50:02.276718+0000","last_unstale":"2022-03-15T05:50:02.278650+0000","last_undegraded":"2022-03-15T05:50:02.278650+0000","last_fullsized":"2022-03-15T05:50:02.278650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:56:31.659289+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261713+0000","last_change":"2022-03-15T05:50:01.764679+0000","last_active":"2022-03-15T05:50:02.261713+0000","last_peered":"2022-03-15T05:50:02.261713+0000","last_clean":"2022-03-15T05:50:02.261713+0000","last_became_active":"2022-03-15T05:50:01.761848+0000","last_became_peered":"2022-03-15T05:50:01.761848+0000","last_unstale":"2022-03-15T05:50:02.261713+0000","last_undegraded":"2022-03-15T05:50:02.261713+0000","last_fullsized":"2022-03-15T05:50:02.261713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:14:14.162973+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286066+0000","last_change":"2022-03-15T05:50:02.283961+0000","last_active":"2022-03-15T05:50:02.286066+0000","last_peered":"2022-03-15T05:50:02.286066+0000","last_clean":"2022-03-15T05:50:02.286066+0000","last_became_active":"2022-03-15T05:50:02.283237+0000","last_became_peered":"2022-03-15T05:50:02.283237+0000","last_unstale":"2022-03-15T05:50:02.286066+0000","last_undegraded":"2022-03-15T05:50:02.286066+0000","last_fullsized":"2022-03-15T05:50:02.286066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:42:49.764129+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261036+0000","last_change":"2022-03-15T05:50:01.767200+0000","last_active":"2022-03-15T05:50:02.261036+0000","last_peered":"2022-03-15T05:50:02.261036+0000","last_clean":"2022-03-15T05:50:02.261036+0000","last_became_active":"2022-03-15T05:50:01.766581+0000","last_became_peered":"2022-03-15T05:50:01.766581+0000","last_unstale":"2022-03-15T05:50:02.261036+0000","last_undegraded":"2022-03-15T05:50:02.261036+0000","last_fullsized":"2022-03-15T05:50:02.261036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:58:11.088344+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275948+0000","last_change":"2022-03-15T05:50:02.270649+0000","last_active":"2022-03-15T05:50:02.275948+0000","last_peered":"2022-03-15T05:50:02.275948+0000","last_clean":"2022-03-15T05:50:02.275948+0000","last_became_active":"2022-03-15T05:50:02.270308+0000","last_became_peered":"2022-03-15T05:50:02.270308+0000","last_unstale":"2022-03-15T05:50:02.275948+0000","last_undegraded":"2022-03-15T05:50:02.275948+0000","last_fullsized":"2022-03-15T05:50:02.275948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:18:01.692755+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263279+0000","last_change":"2022-03-15T05:50:01.758464+0000","last_active":"2022-03-15T05:50:02.263279+0000","last_peered":"2022-03-15T05:50:02.263279+0000","last_clean":"2022-03-15T05:50:02.263279+0000","last_became_active":"2022-03-15T05:50:01.757936+0000","last_became_peered":"2022-03-15T05:50:01.757936+0000","last_unstale":"2022-03-15T05:50:02.263279+0000","last_undegraded":"2022-03-15T05:50:02.263279+0000","last_fullsized":"2022-03-15T05:50:02.263279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:44:19.373542+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278115+0000","last_change":"2022-03-15T05:50:02.270500+0000","last_active":"2022-03-15T05:50:02.278115+0000","last_peered":"2022-03-15T05:50:02.278115+0000","last_clean":"2022-03-15T05:50:02.278115+0000","last_became_active":"2022-03-15T05:50:02.270165+0000","last_became_peered":"2022-03-15T05:50:02.270165+0000","last_unstale":"2022-03-15T05:50:02.278115+0000","last_undegraded":"2022-03-15T05:50:02.278115+0000","last_fullsized":"2022-03-15T05:50:02.278115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:20:11.113002+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267755+0000","last_change":"2022-03-15T05:49:56.006265+0000","last_active":"2022-03-15T05:50:02.267755+0000","last_peered":"2022-03-15T05:50:02.267755+0000","last_clean":"2022-03-15T05:50:02.267755+0000","last_became_active":"2022-03-15T05:49:56.005945+0000","last_became_peered":"2022-03-15T05:49:56.005945+0000","last_unstale":"2022-03-15T05:50:02.267755+0000","last_undegraded":"2022-03-15T05:50:02.267755+0000","last_fullsized":"2022-03-15T05:50:02.267755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T05:59:10.545960+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.256784+0000","last_change":"2022-03-15T05:50:01.756552+0000","last_active":"2022-03-15T05:50:02.256784+0000","last_peered":"2022-03-15T05:50:02.256784+0000","last_clean":"2022-03-15T05:50:02.256784+0000","last_became_active":"2022-03-15T05:50:01.755731+0000","last_became_peered":"2022-03-15T05:50:01.755731+0000","last_unstale":"2022-03-15T05:50:02.256784+0000","last_undegraded":"2022-03-15T05:50:02.256784+0000","last_fullsized":"2022-03-15T05:50:02.256784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:20:06.863246+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277227+0000","last_change":"2022-03-15T05:50:02.271788+0000","last_active":"2022-03-15T05:50:02.277227+0000","last_peered":"2022-03-15T05:50:02.277227+0000","last_clean":"2022-03-15T05:50:02.277227+0000","last_became_active":"2022-03-15T05:50:02.271479+0000","last_became_peered":"2022-03-15T05:50:02.271479+0000","last_unstale":"2022-03-15T05:50:02.277227+0000","last_undegraded":"2022-03-15T05:50:02.277227+0000","last_fullsized":"2022-03-15T05:50:02.277227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:50:05.553818+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261866+0000","last_change":"2022-03-15T05:49:56.006179+0000","last_active":"2022-03-15T05:50:02.261866+0000","last_peered":"2022-03-15T05:50:02.261866+0000","last_clean":"2022-03-15T05:50:02.261866+0000","last_became_active":"2022-03-15T05:49:56.005909+0000","last_became_peered":"2022-03-15T05:49:56.005909+0000","last_unstale":"2022-03-15T05:50:02.261866+0000","last_undegraded":"2022-03-15T05:50:02.261866+0000","last_fullsized":"2022-03-15T05:50:02.261866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:24:44.215515+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.262943+0000","last_change":"2022-03-15T05:50:01.764346+0000","last_active":"2022-03-15T05:50:02.262943+0000","last_peered":"2022-03-15T05:50:02.262943+0000","last_clean":"2022-03-15T05:50:02.262943+0000","last_became_active":"2022-03-15T05:50:01.763997+0000","last_became_peered":"2022-03-15T05:50:01.763997+0000","last_unstale":"2022-03-15T05:50:02.262943+0000","last_undegraded":"2022-03-15T05:50:02.262943+0000","last_fullsized":"2022-03-15T05:50:02.262943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:50:52.655627+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279198+0000","last_change":"2022-03-15T05:50:02.276942+0000","last_active":"2022-03-15T05:50:02.279198+0000","last_peered":"2022-03-15T05:50:02.279198+0000","last_clean":"2022-03-15T05:50:02.279198+0000","last_became_active":"2022-03-15T05:50:02.276353+0000","last_became_peered":"2022-03-15T05:50:02.276353+0000","last_unstale":"2022-03-15T05:50:02.279198+0000","last_undegraded":"2022-03-15T05:50:02.279198+0000","last_fullsized":"2022-03-15T05:50:02.279198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:30:47.020786+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.259035+0000","last_change":"2022-03-15T05:49:55.717507+0000","last_active":"2022-03-15T05:50:02.259035+0000","last_peered":"2022-03-15T05:50:02.259035+0000","last_clean":"2022-03-15T05:50:02.259035+0000","last_became_active":"2022-03-15T05:49:55.717125+0000","last_became_peered":"2022-03-15T05:49:55.717125+0000","last_unstale":"2022-03-15T05:50:02.259035+0000","last_undegraded":"2022-03-15T05:50:02.259035+0000","last_fullsized":"2022-03-15T05:50:02.259035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:01:26.511571+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266522+0000","last_change":"2022-03-15T05:50:01.756925+0000","last_active":"2022-03-15T05:50:02.266522+0000","last_peered":"2022-03-15T05:50:02.266522+0000","last_clean":"2022-03-15T05:50:02.266522+0000","last_became_active":"2022-03-15T05:50:01.756195+0000","last_became_peered":"2022-03-15T05:50:01.756195+0000","last_unstale":"2022-03-15T05:50:02.266522+0000","last_undegraded":"2022-03-15T05:50:02.266522+0000","last_fullsized":"2022-03-15T05:50:02.266522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:37:07.377792+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277317+0000","last_change":"2022-03-15T05:50:02.272291+0000","last_active":"2022-03-15T05:50:02.277317+0000","last_peered":"2022-03-15T05:50:02.277317+0000","last_clean":"2022-03-15T05:50:02.277317+0000","last_became_active":"2022-03-15T05:50:02.271963+0000","last_became_peered":"2022-03-15T05:50:02.271963+0000","last_unstale":"2022-03-15T05:50:02.277317+0000","last_undegraded":"2022-03-15T05:50:02.277317+0000","last_fullsized":"2022-03-15T05:50:02.277317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:39:02.228387+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.264335+0000","last_change":"2022-03-15T05:49:55.714924+0000","last_active":"2022-03-15T05:50:02.264335+0000","last_peered":"2022-03-15T05:50:02.264335+0000","last_clean":"2022-03-15T05:50:02.264335+0000","last_became_active":"2022-03-15T05:49:55.714704+0000","last_became_peered":"2022-03-15T05:49:55.714704+0000","last_unstale":"2022-03-15T05:50:02.264335+0000","last_undegraded":"2022-03-15T05:50:02.264335+0000","last_fullsized":"2022-03-15T05:50:02.264335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:17:23.776392+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261862+0000","last_change":"2022-03-15T05:49:48.418992+0000","last_active":"2022-03-15T05:50:02.261862+0000","last_peered":"2022-03-15T05:50:02.261862+0000","last_clean":"2022-03-15T05:50:02.261862+0000","last_became_active":"2022-03-15T05:49:48.417864+0000","last_became_peered":"2022-03-15T05:49:48.417864+0000","last_unstale":"2022-03-15T05:50:02.261862+0000","last_undegraded":"2022-03-15T05:50:02.261862+0000","last_fullsized":"2022-03-15T05:50:02.261862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:47.305366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:47.305366+0000","last_clean_scrub_stamp":"2022-03-15T05:49:47.305366+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:06:48.812663+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.265735+0000","last_change":"2022-03-15T05:50:01.768622+0000","last_active":"2022-03-15T05:50:02.265735+0000","last_peered":"2022-03-15T05:50:02.265735+0000","last_clean":"2022-03-15T05:50:02.265735+0000","last_became_active":"2022-03-15T05:50:01.768270+0000","last_became_peered":"2022-03-15T05:50:01.768270+0000","last_unstale":"2022-03-15T05:50:02.265735+0000","last_undegraded":"2022-03-15T05:50:02.265735+0000","last_fullsized":"2022-03-15T05:50:02.265735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:53:03.610048+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286021+0000","last_change":"2022-03-15T05:50:02.283485+0000","last_active":"2022-03-15T05:50:02.286021+0000","last_peered":"2022-03-15T05:50:02.286021+0000","last_clean":"2022-03-15T05:50:02.286021+0000","last_became_active":"2022-03-15T05:50:02.282868+0000","last_became_peered":"2022-03-15T05:50:02.282868+0000","last_unstale":"2022-03-15T05:50:02.286021+0000","last_undegraded":"2022-03-15T05:50:02.286021+0000","last_fullsized":"2022-03-15T05:50:02.286021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:41:46.412779+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261606+0000","last_change":"2022-03-15T05:49:55.717054+0000","last_active":"2022-03-15T05:50:02.261606+0000","last_peered":"2022-03-15T05:50:02.261606+0000","last_clean":"2022-03-15T05:50:02.261606+0000","last_became_active":"2022-03-15T05:49:55.716665+0000","last_became_peered":"2022-03-15T05:49:55.716665+0000","last_unstale":"2022-03-15T05:50:02.261606+0000","last_undegraded":"2022-03-15T05:50:02.261606+0000","last_fullsized":"2022-03-15T05:50:02.261606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:39:40.811968+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263842+0000","last_change":"2022-03-15T05:50:01.759408+0000","last_active":"2022-03-15T05:50:02.263842+0000","last_peered":"2022-03-15T05:50:02.263842+0000","last_clean":"2022-03-15T05:50:02.263842+0000","last_became_active":"2022-03-15T05:50:01.759087+0000","last_became_peered":"2022-03-15T05:50:01.759087+0000","last_unstale":"2022-03-15T05:50:02.263842+0000","last_undegraded":"2022-03-15T05:50:02.263842+0000","last_fullsized":"2022-03-15T05:50:02.263842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:16:33.815600+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273561+0000","last_change":"2022-03-15T05:50:02.270677+0000","last_active":"2022-03-15T05:50:02.273561+0000","last_peered":"2022-03-15T05:50:02.273561+0000","last_clean":"2022-03-15T05:50:02.273561+0000","last_became_active":"2022-03-15T05:50:02.270124+0000","last_became_peered":"2022-03-15T05:50:02.270124+0000","last_unstale":"2022-03-15T05:50:02.273561+0000","last_undegraded":"2022-03-15T05:50:02.273561+0000","last_fullsized":"2022-03-15T05:50:02.273561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:08:06.976250+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.264706+0000","last_change":"2022-03-15T05:49:55.717051+0000","last_active":"2022-03-15T05:50:02.264706+0000","last_peered":"2022-03-15T05:50:02.264706+0000","last_clean":"2022-03-15T05:50:02.264706+0000","last_became_active":"2022-03-15T05:49:55.716645+0000","last_became_peered":"2022-03-15T05:49:55.716645+0000","last_unstale":"2022-03-15T05:50:02.264706+0000","last_undegraded":"2022-03-15T05:50:02.264706+0000","last_fullsized":"2022-03-15T05:50:02.264706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:30:50.088264+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.265664+0000","last_change":"2022-03-15T05:50:01.751284+0000","last_active":"2022-03-15T05:50:02.265664+0000","last_peered":"2022-03-15T05:50:02.265664+0000","last_clean":"2022-03-15T05:50:02.265664+0000","last_became_active":"2022-03-15T05:50:01.750703+0000","last_became_peered":"2022-03-15T05:50:01.750703+0000","last_unstale":"2022-03-15T05:50:02.265664+0000","last_undegraded":"2022-03-15T05:50:02.265664+0000","last_fullsized":"2022-03-15T05:50:02.265664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:38:23.932929+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277357+0000","last_change":"2022-03-15T05:50:02.272088+0000","last_active":"2022-03-15T05:50:02.277357+0000","last_peered":"2022-03-15T05:50:02.277357+0000","last_clean":"2022-03-15T05:50:02.277357+0000","last_became_active":"2022-03-15T05:50:02.271791+0000","last_became_peered":"2022-03-15T05:50:02.271791+0000","last_unstale":"2022-03-15T05:50:02.277357+0000","last_undegraded":"2022-03-15T05:50:02.277357+0000","last_fullsized":"2022-03-15T05:50:02.277357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:47:55.992221+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267595+0000","last_change":"2022-03-15T05:50:01.760181+0000","last_active":"2022-03-15T05:50:02.267595+0000","last_peered":"2022-03-15T05:50:02.267595+0000","last_clean":"2022-03-15T05:50:02.267595+0000","last_became_active":"2022-03-15T05:50:01.758933+0000","last_became_peered":"2022-03-15T05:50:01.758933+0000","last_unstale":"2022-03-15T05:50:02.267595+0000","last_undegraded":"2022-03-15T05:50:02.267595+0000","last_fullsized":"2022-03-15T05:50:02.267595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:07:34.261671+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266242+0000","last_change":"2022-03-15T05:49:56.021984+0000","last_active":"2022-03-15T05:50:02.266242+0000","last_peered":"2022-03-15T05:50:02.266242+0000","last_clean":"2022-03-15T05:50:02.266242+0000","last_became_active":"2022-03-15T05:49:56.021731+0000","last_became_peered":"2022-03-15T05:49:56.021731+0000","last_unstale":"2022-03-15T05:50:02.266242+0000","last_undegraded":"2022-03-15T05:50:02.266242+0000","last_fullsized":"2022-03-15T05:50:02.266242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:28:10.949766+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284752+0000","last_change":"2022-03-15T05:50:02.283078+0000","last_active":"2022-03-15T05:50:02.284752+0000","last_peered":"2022-03-15T05:50:02.284752+0000","last_clean":"2022-03-15T05:50:02.284752+0000","last_became_active":"2022-03-15T05:50:02.282773+0000","last_became_peered":"2022-03-15T05:50:02.282773+0000","last_unstale":"2022-03-15T05:50:02.284752+0000","last_undegraded":"2022-03-15T05:50:02.284752+0000","last_fullsized":"2022-03-15T05:50:02.284752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:30:20.154884+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261311+0000","last_change":"2022-03-15T05:49:56.021748+0000","last_active":"2022-03-15T05:50:02.261311+0000","last_peered":"2022-03-15T05:50:02.261311+0000","last_clean":"2022-03-15T05:50:02.261311+0000","last_became_active":"2022-03-15T05:49:56.021377+0000","last_became_peered":"2022-03-15T05:49:56.021377+0000","last_unstale":"2022-03-15T05:50:02.261311+0000","last_undegraded":"2022-03-15T05:50:02.261311+0000","last_fullsized":"2022-03-15T05:50:02.261311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:26:22.203948+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266443+0000","last_change":"2022-03-15T05:50:01.758476+0000","last_active":"2022-03-15T05:50:02.266443+0000","last_peered":"2022-03-15T05:50:02.266443+0000","last_clean":"2022-03-15T05:50:02.266443+0000","last_became_active":"2022-03-15T05:50:01.757859+0000","last_became_peered":"2022-03-15T05:50:01.757859+0000","last_unstale":"2022-03-15T05:50:02.266443+0000","last_undegraded":"2022-03-15T05:50:02.266443+0000","last_fullsized":"2022-03-15T05:50:02.266443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:18:49.740446+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279752+0000","last_change":"2022-03-15T05:50:02.271202+0000","last_active":"2022-03-15T05:50:02.279752+0000","last_peered":"2022-03-15T05:50:02.279752+0000","last_clean":"2022-03-15T05:50:02.279752+0000","last_became_active":"2022-03-15T05:50:02.270717+0000","last_became_peered":"2022-03-15T05:50:02.270717+0000","last_unstale":"2022-03-15T05:50:02.279752+0000","last_undegraded":"2022-03-15T05:50:02.279752+0000","last_fullsized":"2022-03-15T05:50:02.279752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:57:17.654890+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266030+0000","last_change":"2022-03-15T05:50:01.768300+0000","last_active":"2022-03-15T05:50:02.266030+0000","last_peered":"2022-03-15T05:50:02.266030+0000","last_clean":"2022-03-15T05:50:02.266030+0000","last_became_active":"2022-03-15T05:50:01.767955+0000","last_became_peered":"2022-03-15T05:50:01.767955+0000","last_unstale":"2022-03-15T05:50:02.266030+0000","last_undegraded":"2022-03-15T05:50:02.266030+0000","last_fullsized":"2022-03-15T05:50:02.266030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:10:41.738813+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280244+0000","last_change":"2022-03-15T05:50:02.276173+0000","last_active":"2022-03-15T05:50:02.280244+0000","last_peered":"2022-03-15T05:50:02.280244+0000","last_clean":"2022-03-15T05:50:02.280244+0000","last_became_active":"2022-03-15T05:50:02.275805+0000","last_became_peered":"2022-03-15T05:50:02.275805+0000","last_unstale":"2022-03-15T05:50:02.280244+0000","last_undegraded":"2022-03-15T05:50:02.280244+0000","last_fullsized":"2022-03-15T05:50:02.280244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:20:32.284452+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.260815+0000","last_change":"2022-03-15T05:50:01.769303+0000","last_active":"2022-03-15T05:50:02.260815+0000","last_peered":"2022-03-15T05:50:02.260815+0000","last_clean":"2022-03-15T05:50:02.260815+0000","last_became_active":"2022-03-15T05:50:01.768420+0000","last_became_peered":"2022-03-15T05:50:01.768420+0000","last_unstale":"2022-03-15T05:50:02.260815+0000","last_undegraded":"2022-03-15T05:50:02.260815+0000","last_fullsized":"2022-03-15T05:50:02.260815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:52:53.780299+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275161+0000","last_change":"2022-03-15T05:50:02.269010+0000","last_active":"2022-03-15T05:50:02.275161+0000","last_peered":"2022-03-15T05:50:02.275161+0000","last_clean":"2022-03-15T05:50:02.275161+0000","last_became_active":"2022-03-15T05:50:02.268702+0000","last_became_peered":"2022-03-15T05:50:02.268702+0000","last_unstale":"2022-03-15T05:50:02.275161+0000","last_undegraded":"2022-03-15T05:50:02.275161+0000","last_fullsized":"2022-03-15T05:50:02.275161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:21:36.546324+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.265743+0000","last_change":"2022-03-15T05:50:01.769060+0000","last_active":"2022-03-15T05:50:07.265743+0000","last_peered":"2022-03-15T05:50:07.265743+0000","last_clean":"2022-03-15T05:50:07.265743+0000","last_became_active":"2022-03-15T05:50:01.768832+0000","last_became_peered":"2022-03-15T05:50:01.768832+0000","last_unstale":"2022-03-15T05:50:07.265743+0000","last_undegraded":"2022-03-15T05:50:07.265743+0000","last_fullsized":"2022-03-15T05:50:07.265743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:08:34.598986+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277210+0000","last_change":"2022-03-15T05:50:02.269955+0000","last_active":"2022-03-15T05:50:02.277210+0000","last_peered":"2022-03-15T05:50:02.277210+0000","last_clean":"2022-03-15T05:50:02.277210+0000","last_became_active":"2022-03-15T05:50:02.268808+0000","last_became_peered":"2022-03-15T05:50:02.268808+0000","last_unstale":"2022-03-15T05:50:02.277210+0000","last_undegraded":"2022-03-15T05:50:02.277210+0000","last_fullsized":"2022-03-15T05:50:02.277210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:42:50.905588+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267659+0000","last_change":"2022-03-15T05:50:01.758736+0000","last_active":"2022-03-15T05:50:02.267659+0000","last_peered":"2022-03-15T05:50:02.267659+0000","last_clean":"2022-03-15T05:50:02.267659+0000","last_became_active":"2022-03-15T05:50:01.758333+0000","last_became_peered":"2022-03-15T05:50:01.758333+0000","last_unstale":"2022-03-15T05:50:02.267659+0000","last_undegraded":"2022-03-15T05:50:02.267659+0000","last_fullsized":"2022-03-15T05:50:02.267659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:58:43.148420+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277947+0000","last_change":"2022-03-15T05:50:02.269606+0000","last_active":"2022-03-15T05:50:02.277947+0000","last_peered":"2022-03-15T05:50:02.277947+0000","last_clean":"2022-03-15T05:50:02.277947+0000","last_became_active":"2022-03-15T05:50:02.268919+0000","last_became_peered":"2022-03-15T05:50:02.268919+0000","last_unstale":"2022-03-15T05:50:02.277947+0000","last_undegraded":"2022-03-15T05:50:02.277947+0000","last_fullsized":"2022-03-15T05:50:02.277947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:07:44.276834+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267837+0000","last_change":"2022-03-15T05:50:01.756439+0000","last_active":"2022-03-15T05:50:02.267837+0000","last_peered":"2022-03-15T05:50:02.267837+0000","last_clean":"2022-03-15T05:50:02.267837+0000","last_became_active":"2022-03-15T05:50:01.756088+0000","last_became_peered":"2022-03-15T05:50:01.756088+0000","last_unstale":"2022-03-15T05:50:02.267837+0000","last_undegraded":"2022-03-15T05:50:02.267837+0000","last_fullsized":"2022-03-15T05:50:02.267837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:46:26.623500+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275939+0000","last_change":"2022-03-15T05:50:02.271501+0000","last_active":"2022-03-15T05:50:02.275939+0000","last_peered":"2022-03-15T05:50:02.275939+0000","last_clean":"2022-03-15T05:50:02.275939+0000","last_became_active":"2022-03-15T05:50:02.271187+0000","last_became_peered":"2022-03-15T05:50:02.271187+0000","last_unstale":"2022-03-15T05:50:02.275939+0000","last_undegraded":"2022-03-15T05:50:02.275939+0000","last_fullsized":"2022-03-15T05:50:02.275939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:54:59.344451+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279026+0000","last_change":"2022-03-15T05:50:02.274406+0000","last_active":"2022-03-15T05:50:02.279026+0000","last_peered":"2022-03-15T05:50:02.279026+0000","last_clean":"2022-03-15T05:50:02.279026+0000","last_became_active":"2022-03-15T05:50:02.274125+0000","last_became_peered":"2022-03-15T05:50:02.274125+0000","last_unstale":"2022-03-15T05:50:02.279026+0000","last_undegraded":"2022-03-15T05:50:02.279026+0000","last_fullsized":"2022-03-15T05:50:02.279026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:29:08.737054+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277189+0000","last_change":"2022-03-15T05:50:02.272438+0000","last_active":"2022-03-15T05:50:02.277189+0000","last_peered":"2022-03-15T05:50:02.277189+0000","last_clean":"2022-03-15T05:50:02.277189+0000","last_became_active":"2022-03-15T05:50:02.272170+0000","last_became_peered":"2022-03-15T05:50:02.272170+0000","last_unstale":"2022-03-15T05:50:02.277189+0000","last_undegraded":"2022-03-15T05:50:02.277189+0000","last_fullsized":"2022-03-15T05:50:02.277189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:48:35.986901+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.287816+0000","last_change":"2022-03-15T05:50:02.283839+0000","last_active":"2022-03-15T05:50:02.287816+0000","last_peered":"2022-03-15T05:50:02.287816+0000","last_clean":"2022-03-15T05:50:02.287816+0000","last_became_active":"2022-03-15T05:50:02.283609+0000","last_became_peered":"2022-03-15T05:50:02.283609+0000","last_unstale":"2022-03-15T05:50:02.287816+0000","last_undegraded":"2022-03-15T05:50:02.287816+0000","last_fullsized":"2022-03-15T05:50:02.287816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:12:07.158629+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280963+0000","last_change":"2022-03-15T05:50:02.279440+0000","last_active":"2022-03-15T05:50:02.280963+0000","last_peered":"2022-03-15T05:50:02.280963+0000","last_clean":"2022-03-15T05:50:02.280963+0000","last_became_active":"2022-03-15T05:50:02.279161+0000","last_became_peered":"2022-03-15T05:50:02.279161+0000","last_unstale":"2022-03-15T05:50:02.280963+0000","last_undegraded":"2022-03-15T05:50:02.280963+0000","last_fullsized":"2022-03-15T05:50:02.280963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:51:31.533566+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.271955+0000","last_change":"2022-03-15T05:50:02.269218+0000","last_active":"2022-03-15T05:50:02.271955+0000","last_peered":"2022-03-15T05:50:02.271955+0000","last_clean":"2022-03-15T05:50:02.271955+0000","last_became_active":"2022-03-15T05:50:02.268768+0000","last_became_peered":"2022-03-15T05:50:02.268768+0000","last_unstale":"2022-03-15T05:50:02.271955+0000","last_undegraded":"2022-03-15T05:50:02.271955+0000","last_fullsized":"2022-03-15T05:50:02.271955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:17:44.234889+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1652,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":93616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7940,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363900,"statfs":{"total":96636764160,"available":96628633600,"internally_reserved":0,"allocated":258048,"data_stored":93512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":778240,"data_stored":620892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":91964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":91964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":91964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8956,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94362884,"statfs":{"total":96636764160,"available":96627593216,"internally_reserved":0,"allocated":774144,"data_stored":619233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":90305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-03-15T05:50:09.049 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-03-15T05:50:09.288 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.286+0000 7f407bfed700 1 Processor -- start 2022-03-15T05:50:09.288 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.286+0000 7f407bfed700 1 -- start start 2022-03-15T05:50:09.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.287+0000 7f407bfed700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40740bd750 0x7f4074151750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.287+0000 7f407bfed700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f40740c2220 0x7f407406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.287+0000 7f407bfed700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40740c14f0 con 0x7f4074067ba0 2022-03-15T05:50:09.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.287+0000 7f407bfed700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40740c1d90 con 0x7f40740bd750 2022-03-15T05:50:09.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.287+0000 7f407bfed700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f407414b4e0 con 0x7f40740c2220 2022-03-15T05:50:09.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f4079d89700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40740bd750 0x7f4074151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f4079588700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f40740c2220 0x7f407406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f407a58a700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f4074067ba0 0x7f4074066980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33648/0 (socket says 172.21.15.151:33648) 2022-03-15T05:50:09.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f407a58a700 1 -- 172.21.15.151:0/2939868863 learned_addr learned my addr 172.21.15.151:0/2939868863 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:09.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f4079d89700 1 --2- 172.21.15.151:0/2939868863 >> v2:172.21.15.151:3300/0 conn(0x7f40740bd750 0x7f4074151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60008/0 (socket says 172.21.15.151:60008) 2022-03-15T05:50:09.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f4078d87700 1 -- 172.21.15.151:0/2939868863 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503999777 0 0) 0x7f40740c14f0 con 0x7f4074067ba0 2022-03-15T05:50:09.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f4079d89700 1 -- 172.21.15.151:0/2939868863 >> v2:172.21.15.164:3300/0 conn(0x7f40740c2220 msgr2=0x7f407406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:09.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f4079d89700 1 --2- 172.21.15.151:0/2939868863 >> v2:172.21.15.164:3300/0 conn(0x7f40740c2220 0x7f407406c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f4079d89700 1 -- 172.21.15.151:0/2939868863 >> v1:172.21.15.164:6789/0 conn(0x7f4074067ba0 legacy=0x7f4074066980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f4079d89700 1 -- 172.21.15.151:0/2939868863 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40740c2a10 con 0x7f40740bd750 2022-03-15T05:50:09.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.288+0000 7f4079588700 1 --2- 172.21.15.151:0/2939868863 >> v2:172.21.15.164:3300/0 conn(0x7f40740c2220 0x7f407406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:09.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.289+0000 7f4079d89700 1 --2- 172.21.15.151:0/2939868863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 0x7f4074151750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f40740689e0 tx=0x7f4070009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de140655f10b4b25 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:09.295 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.289+0000 7f4078d87700 1 -- 172.21.15.151:0/2939868863 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070011630 con 0x7f40740bd750 2022-03-15T05:50:09.295 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.289+0000 7f4078d87700 1 -- 172.21.15.151:0/2939868863 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4070011790 con 0x7f40740bd750 2022-03-15T05:50:09.295 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.289+0000 7f4078d87700 1 -- 172.21.15.151:0/2939868863 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4070011b30 con 0x7f40740bd750 2022-03-15T05:50:09.299 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.289+0000 7f407bfed700 1 -- 172.21.15.151:0/2939868863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 msgr2=0x7f4074151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.299 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.289+0000 7f407bfed700 1 --2- 172.21.15.151:0/2939868863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 0x7f4074151750 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f40740689e0 tx=0x7f4070009060 comp rx=0 tx=0).stop 2022-03-15T05:50:09.299 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.289+0000 7f407bfed700 1 -- 172.21.15.151:0/2939868863 shutdown_connections 2022-03-15T05:50:09.300 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.289+0000 7f407bfed700 1 --2- 172.21.15.151:0/2939868863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 0x7f4074151750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.300 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.289+0000 7f407bfed700 1 --2- 172.21.15.151:0/2939868863 >> v2:172.21.15.164:3300/0 conn(0x7f40740c2220 0x7f407406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.300 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.289+0000 7f407bfed700 1 -- 172.21.15.151:0/2939868863 >> 172.21.15.151:0/2939868863 conn(0x7f40740c75c0 msgr2=0x7f40740c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:09.300 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.290+0000 7f407bfed700 1 -- 172.21.15.151:0/2939868863 shutdown_connections 2022-03-15T05:50:09.301 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.290+0000 7f407bfed700 1 -- 172.21.15.151:0/2939868863 wait complete. 2022-03-15T05:50:09.301 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.291+0000 7f407bfed700 1 Processor -- start 2022-03-15T05:50:09.301 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.291+0000 7f407bfed700 1 -- start start 2022-03-15T05:50:09.301 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f407bfed700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4074067ba0 0x7f4074164270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.302 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f407bfed700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 0x7f4074150eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.302 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f407bfed700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40740c2220 0x7f407414dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.302 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f407bfed700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40741466c0 con 0x7f40740bd750 2022-03-15T05:50:09.302 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f407bfed700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407414d880 con 0x7f4074067ba0 2022-03-15T05:50:09.303 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f407bfed700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4074147980 con 0x7f40740c2220 2022-03-15T05:50:09.303 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f4079588700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 0x7f4074150eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.303 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f4079588700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 0x7f4074150eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60010/0 (socket says 172.21.15.151:60010) 2022-03-15T05:50:09.303 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f4079588700 1 -- 172.21.15.151:0/1643242319 learned_addr learned my addr 172.21.15.151:0/1643242319 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:09.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f407a58a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40740c2220 0x7f407414dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.292+0000 7f4079d89700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4074067ba0 0x7f4074164270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.293+0000 7f4079588700 1 -- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40740c2220 msgr2=0x7f407414dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.293+0000 7f4079588700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40740c2220 0x7f407414dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.293+0000 7f4079588700 1 -- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4074067ba0 msgr2=0x7f4074164270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.293+0000 7f4079588700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4074067ba0 0x7f4074164270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.293+0000 7f4079588700 1 -- 172.21.15.151:0/1643242319 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406400b540 con 0x7f40740bd750 2022-03-15T05:50:09.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.293+0000 7f4079588700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 0x7f4074150eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f406400ebe0 tx=0x7f406400b300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:09.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.293+0000 7f4061ffb700 1 -- 172.21.15.151:0/1643242319 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406400db20 con 0x7f40740bd750 2022-03-15T05:50:09.306 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.293+0000 7f4061ffb700 1 -- 172.21.15.151:0/1643242319 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f406400dc80 con 0x7f40740bd750 2022-03-15T05:50:09.306 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.294+0000 7f407bfed700 1 -- 172.21.15.151:0/1643242319 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40700092a0 con 0x7f40740bd750 2022-03-15T05:50:09.306 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.294+0000 7f4061ffb700 1 -- 172.21.15.151:0/1643242319 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4064010440 con 0x7f40740bd750 2022-03-15T05:50:09.306 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.294+0000 7f407bfed700 1 -- 172.21.15.151:0/1643242319 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4074147f00 con 0x7f40740bd750 2022-03-15T05:50:09.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.295+0000 7f407bfed700 1 -- 172.21.15.151:0/1643242319 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407414d650 con 0x7f40740bd750 2022-03-15T05:50:09.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.296+0000 7f4061ffb700 1 -- 172.21.15.151:0/1643242319 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f40640107b0 con 0x7f40740bd750 2022-03-15T05:50:09.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.296+0000 7f4061ffb700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40540633c0 0x7f4054065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.296+0000 7f4061ffb700 1 -- 172.21.15.151:0/1643242319 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f406407ffb0 con 0x7f40740bd750 2022-03-15T05:50:09.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.297+0000 7f4079d89700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40540633c0 0x7f4054065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.297+0000 7f4079d89700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40540633c0 0x7f4054065870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4070011fd0 tx=0x7f4070017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:09.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.300+0000 7f4061ffb700 1 -- 172.21.15.151:0/1643242319 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f407414d650 con 0x7f40740bd750 2022-03-15T05:50:09.501 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.499+0000 7f407bfed700 1 -- 172.21.15.151:0/1643242319 --> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f407414d650 con 0x7f40540633c0 2022-03-15T05:50:09.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.507+0000 7f4061ffb700 1 -- 172.21.15.151:0/1643242319 <== mgr.4111 v2:172.21.15.164:6832/40466 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278282 (secure 0 0 0) 0x7f407414d650 con 0x7f40540633c0 2022-03-15T05:50:09.515 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:09.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 -- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40540633c0 msgr2=0x7f4054065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40540633c0 0x7f4054065870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4070011fd0 tx=0x7f4070017000 comp rx=0 tx=0).stop 2022-03-15T05:50:09.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 -- 172.21.15.151:0/1643242319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 msgr2=0x7f4074150eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 0x7f4074150eb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f406400ebe0 tx=0x7f406400b300 comp rx=0 tx=0).stop 2022-03-15T05:50:09.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 -- 172.21.15.151:0/1643242319 shutdown_connections 2022-03-15T05:50:09.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40540633c0 0x7f4054065870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40740c2220 0x7f407414dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4074067ba0 0x7f4074164270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 --2- 172.21.15.151:0/1643242319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40740bd750 0x7f4074150eb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 -- 172.21.15.151:0/1643242319 >> 172.21.15.151:0/1643242319 conn(0x7f40740c75c0 msgr2=0x7f40740c6050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:09.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.511+0000 7f407bfed700 1 -- 172.21.15.151:0/1643242319 shutdown_connections 2022-03-15T05:50:09.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.512+0000 7f407bfed700 1 -- 172.21.15.151:0/1643242319 wait complete. 2022-03-15T05:50:09.523 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2022-03-15T05:50:09.538 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2022-03-15T05:50:08.650300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592020,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":175,"num_write_kb":2427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":130,"ondisk_log_size":130,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":65576,"kb_used_data":2984,"kb_used_omap":0,"kb_used_meta":62528,"kb_avail":754909144,"statfs":{"total":773094113280,"available":773026963456,"internally_reserved":0,"allocated":3055616,"data_stored":1793450,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64028672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1652,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.909722"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273754+0000","last_change":"2022-03-15T05:50:02.270526+0000","last_active":"2022-03-15T05:50:02.273754+0000","last_peered":"2022-03-15T05:50:02.273754+0000","last_clean":"2022-03-15T05:50:02.273754+0000","last_became_active":"2022-03-15T05:50:02.270047+0000","last_became_peered":"2022-03-15T05:50:02.270047+0000","last_unstale":"2022-03-15T05:50:02.273754+0000","last_undegraded":"2022-03-15T05:50:02.273754+0000","last_fullsized":"2022-03-15T05:50:02.273754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:19:07.916578+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275970+0000","last_change":"2022-03-15T05:50:02.272082+0000","last_active":"2022-03-15T05:50:02.275970+0000","last_peered":"2022-03-15T05:50:02.275970+0000","last_clean":"2022-03-15T05:50:02.275970+0000","last_became_active":"2022-03-15T05:50:02.271830+0000","last_became_peered":"2022-03-15T05:50:02.271830+0000","last_unstale":"2022-03-15T05:50:02.275970+0000","last_undegraded":"2022-03-15T05:50:02.275970+0000","last_fullsized":"2022-03-15T05:50:02.275970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:11:22.661539+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277940+0000","last_change":"2022-03-15T05:50:02.274527+0000","last_active":"2022-03-15T05:50:02.277940+0000","last_peered":"2022-03-15T05:50:02.277940+0000","last_clean":"2022-03-15T05:50:02.277940+0000","last_became_active":"2022-03-15T05:50:02.274276+0000","last_became_peered":"2022-03-15T05:50:02.274276+0000","last_unstale":"2022-03-15T05:50:02.277940+0000","last_undegraded":"2022-03-15T05:50:02.277940+0000","last_fullsized":"2022-03-15T05:50:02.277940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:30:36.811134+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278491+0000","last_change":"2022-03-15T05:50:02.273391+0000","last_active":"2022-03-15T05:50:02.278491+0000","last_peered":"2022-03-15T05:50:02.278491+0000","last_clean":"2022-03-15T05:50:02.278491+0000","last_became_active":"2022-03-15T05:50:02.273048+0000","last_became_peered":"2022-03-15T05:50:02.273048+0000","last_unstale":"2022-03-15T05:50:02.278491+0000","last_undegraded":"2022-03-15T05:50:02.278491+0000","last_fullsized":"2022-03-15T05:50:02.278491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:29:30.963367+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279283+0000","last_change":"2022-03-15T05:50:02.275876+0000","last_active":"2022-03-15T05:50:02.279283+0000","last_peered":"2022-03-15T05:50:02.279283+0000","last_clean":"2022-03-15T05:50:02.279283+0000","last_became_active":"2022-03-15T05:50:02.275568+0000","last_became_peered":"2022-03-15T05:50:02.275568+0000","last_unstale":"2022-03-15T05:50:02.279283+0000","last_undegraded":"2022-03-15T05:50:02.279283+0000","last_fullsized":"2022-03-15T05:50:02.279283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:49:14.636242+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285627+0000","last_change":"2022-03-15T05:50:02.280155+0000","last_active":"2022-03-15T05:50:02.285627+0000","last_peered":"2022-03-15T05:50:02.285627+0000","last_clean":"2022-03-15T05:50:02.285627+0000","last_became_active":"2022-03-15T05:50:02.279866+0000","last_became_peered":"2022-03-15T05:50:02.279866+0000","last_unstale":"2022-03-15T05:50:02.285627+0000","last_undegraded":"2022-03-15T05:50:02.285627+0000","last_fullsized":"2022-03-15T05:50:02.285627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:18:11.481888+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281731+0000","last_change":"2022-03-15T05:50:02.274634+0000","last_active":"2022-03-15T05:50:02.281731+0000","last_peered":"2022-03-15T05:50:02.281731+0000","last_clean":"2022-03-15T05:50:02.281731+0000","last_became_active":"2022-03-15T05:50:02.274365+0000","last_became_peered":"2022-03-15T05:50:02.274365+0000","last_unstale":"2022-03-15T05:50:02.281731+0000","last_undegraded":"2022-03-15T05:50:02.281731+0000","last_fullsized":"2022-03-15T05:50:02.281731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:30:21.663420+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286792+0000","last_change":"2022-03-15T05:50:02.285013+0000","last_active":"2022-03-15T05:50:02.286792+0000","last_peered":"2022-03-15T05:50:02.286792+0000","last_clean":"2022-03-15T05:50:02.286792+0000","last_became_active":"2022-03-15T05:50:02.284464+0000","last_became_peered":"2022-03-15T05:50:02.284464+0000","last_unstale":"2022-03-15T05:50:02.286792+0000","last_undegraded":"2022-03-15T05:50:02.286792+0000","last_fullsized":"2022-03-15T05:50:02.286792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:46:35.006614+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273371+0000","last_change":"2022-03-15T05:50:02.270735+0000","last_active":"2022-03-15T05:50:02.273371+0000","last_peered":"2022-03-15T05:50:02.273371+0000","last_clean":"2022-03-15T05:50:02.273371+0000","last_became_active":"2022-03-15T05:50:02.270318+0000","last_became_peered":"2022-03-15T05:50:02.270318+0000","last_unstale":"2022-03-15T05:50:02.273371+0000","last_undegraded":"2022-03-15T05:50:02.273371+0000","last_fullsized":"2022-03-15T05:50:02.273371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:12:33.142086+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278502+0000","last_change":"2022-03-15T05:50:02.273007+0000","last_active":"2022-03-15T05:50:02.278502+0000","last_peered":"2022-03-15T05:50:02.278502+0000","last_clean":"2022-03-15T05:50:02.278502+0000","last_became_active":"2022-03-15T05:50:02.272523+0000","last_became_peered":"2022-03-15T05:50:02.272523+0000","last_unstale":"2022-03-15T05:50:02.278502+0000","last_undegraded":"2022-03-15T05:50:02.278502+0000","last_fullsized":"2022-03-15T05:50:02.278502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:21:35.681401+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286135+0000","last_change":"2022-03-15T05:50:02.278777+0000","last_active":"2022-03-15T05:50:02.286135+0000","last_peered":"2022-03-15T05:50:02.286135+0000","last_clean":"2022-03-15T05:50:02.286135+0000","last_became_active":"2022-03-15T05:50:02.278500+0000","last_became_peered":"2022-03-15T05:50:02.278500+0000","last_unstale":"2022-03-15T05:50:02.286135+0000","last_undegraded":"2022-03-15T05:50:02.286135+0000","last_fullsized":"2022-03-15T05:50:02.286135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:38:10.301072+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284707+0000","last_change":"2022-03-15T05:50:02.283008+0000","last_active":"2022-03-15T05:50:02.284707+0000","last_peered":"2022-03-15T05:50:02.284707+0000","last_clean":"2022-03-15T05:50:02.284707+0000","last_became_active":"2022-03-15T05:50:02.282701+0000","last_became_peered":"2022-03-15T05:50:02.282701+0000","last_unstale":"2022-03-15T05:50:02.284707+0000","last_undegraded":"2022-03-15T05:50:02.284707+0000","last_fullsized":"2022-03-15T05:50:02.284707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:27:00.079571+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277381+0000","last_change":"2022-03-15T05:50:02.274545+0000","last_active":"2022-03-15T05:50:02.277381+0000","last_peered":"2022-03-15T05:50:02.277381+0000","last_clean":"2022-03-15T05:50:02.277381+0000","last_became_active":"2022-03-15T05:50:02.274210+0000","last_became_peered":"2022-03-15T05:50:02.274210+0000","last_unstale":"2022-03-15T05:50:02.277381+0000","last_undegraded":"2022-03-15T05:50:02.277381+0000","last_fullsized":"2022-03-15T05:50:02.277381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:56:38.005714+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282124+0000","last_change":"2022-03-15T05:50:02.276880+0000","last_active":"2022-03-15T05:50:02.282124+0000","last_peered":"2022-03-15T05:50:02.282124+0000","last_clean":"2022-03-15T05:50:02.282124+0000","last_became_active":"2022-03-15T05:50:02.276611+0000","last_became_peered":"2022-03-15T05:50:02.276611+0000","last_unstale":"2022-03-15T05:50:02.282124+0000","last_undegraded":"2022-03-15T05:50:02.282124+0000","last_fullsized":"2022-03-15T05:50:02.282124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:00:13.209564+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278683+0000","last_change":"2022-03-15T05:50:02.276997+0000","last_active":"2022-03-15T05:50:02.278683+0000","last_peered":"2022-03-15T05:50:02.278683+0000","last_clean":"2022-03-15T05:50:02.278683+0000","last_became_active":"2022-03-15T05:50:02.276696+0000","last_became_peered":"2022-03-15T05:50:02.276696+0000","last_unstale":"2022-03-15T05:50:02.278683+0000","last_undegraded":"2022-03-15T05:50:02.278683+0000","last_fullsized":"2022-03-15T05:50:02.278683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:00:32.831962+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281465+0000","last_change":"2022-03-15T05:50:02.269800+0000","last_active":"2022-03-15T05:50:02.281465+0000","last_peered":"2022-03-15T05:50:02.281465+0000","last_clean":"2022-03-15T05:50:02.281465+0000","last_became_active":"2022-03-15T05:50:02.269477+0000","last_became_peered":"2022-03-15T05:50:02.269477+0000","last_unstale":"2022-03-15T05:50:02.281465+0000","last_undegraded":"2022-03-15T05:50:02.281465+0000","last_fullsized":"2022-03-15T05:50:02.281465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:24:26.061545+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275881+0000","last_change":"2022-03-15T05:50:02.269504+0000","last_active":"2022-03-15T05:50:02.275881+0000","last_peered":"2022-03-15T05:50:02.275881+0000","last_clean":"2022-03-15T05:50:02.275881+0000","last_became_active":"2022-03-15T05:50:02.269199+0000","last_became_peered":"2022-03-15T05:50:02.269199+0000","last_unstale":"2022-03-15T05:50:02.275881+0000","last_undegraded":"2022-03-15T05:50:02.275881+0000","last_fullsized":"2022-03-15T05:50:02.275881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:48:27.314870+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280537+0000","last_change":"2022-03-15T05:50:02.271878+0000","last_active":"2022-03-15T05:50:02.280537+0000","last_peered":"2022-03-15T05:50:02.280537+0000","last_clean":"2022-03-15T05:50:02.280537+0000","last_became_active":"2022-03-15T05:50:02.271545+0000","last_became_peered":"2022-03-15T05:50:02.271545+0000","last_unstale":"2022-03-15T05:50:02.280537+0000","last_undegraded":"2022-03-15T05:50:02.280537+0000","last_fullsized":"2022-03-15T05:50:02.280537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:29:55.714092+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284711+0000","last_change":"2022-03-15T05:50:02.283062+0000","last_active":"2022-03-15T05:50:02.284711+0000","last_peered":"2022-03-15T05:50:02.284711+0000","last_clean":"2022-03-15T05:50:02.284711+0000","last_became_active":"2022-03-15T05:50:02.282688+0000","last_became_peered":"2022-03-15T05:50:02.282688+0000","last_unstale":"2022-03-15T05:50:02.284711+0000","last_undegraded":"2022-03-15T05:50:02.284711+0000","last_fullsized":"2022-03-15T05:50:02.284711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:28:47.117343+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.276419+0000","last_change":"2022-03-15T05:50:02.267259+0000","last_active":"2022-03-15T05:50:02.276419+0000","last_peered":"2022-03-15T05:50:02.276419+0000","last_clean":"2022-03-15T05:50:02.276419+0000","last_became_active":"2022-03-15T05:50:02.266987+0000","last_became_peered":"2022-03-15T05:50:02.266987+0000","last_unstale":"2022-03-15T05:50:02.276419+0000","last_undegraded":"2022-03-15T05:50:02.276419+0000","last_fullsized":"2022-03-15T05:50:02.276419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:58:11.812955+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280321+0000","last_change":"2022-03-15T05:50:02.276941+0000","last_active":"2022-03-15T05:50:02.280321+0000","last_peered":"2022-03-15T05:50:02.280321+0000","last_clean":"2022-03-15T05:50:02.280321+0000","last_became_active":"2022-03-15T05:50:02.276681+0000","last_became_peered":"2022-03-15T05:50:02.276681+0000","last_unstale":"2022-03-15T05:50:02.280321+0000","last_undegraded":"2022-03-15T05:50:02.280321+0000","last_fullsized":"2022-03-15T05:50:02.280321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:33:21.840005+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.269747+0000","last_change":"2022-03-15T05:50:02.269105+0000","last_active":"2022-03-15T05:50:02.269747+0000","last_peered":"2022-03-15T05:50:02.269747+0000","last_clean":"2022-03-15T05:50:02.269747+0000","last_became_active":"2022-03-15T05:50:02.268808+0000","last_became_peered":"2022-03-15T05:50:02.268808+0000","last_unstale":"2022-03-15T05:50:02.269747+0000","last_undegraded":"2022-03-15T05:50:02.269747+0000","last_fullsized":"2022-03-15T05:50:02.269747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:52:28.049853+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280638+0000","last_change":"2022-03-15T05:50:02.277497+0000","last_active":"2022-03-15T05:50:02.280638+0000","last_peered":"2022-03-15T05:50:02.280638+0000","last_clean":"2022-03-15T05:50:02.280638+0000","last_became_active":"2022-03-15T05:50:02.277184+0000","last_became_peered":"2022-03-15T05:50:02.277184+0000","last_unstale":"2022-03-15T05:50:02.280638+0000","last_undegraded":"2022-03-15T05:50:02.280638+0000","last_fullsized":"2022-03-15T05:50:02.280638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:35:31.460982+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280352+0000","last_change":"2022-03-15T05:50:02.277944+0000","last_active":"2022-03-15T05:50:02.280352+0000","last_peered":"2022-03-15T05:50:02.280352+0000","last_clean":"2022-03-15T05:50:02.280352+0000","last_became_active":"2022-03-15T05:50:02.277565+0000","last_became_peered":"2022-03-15T05:50:02.277565+0000","last_unstale":"2022-03-15T05:50:02.280352+0000","last_undegraded":"2022-03-15T05:50:02.280352+0000","last_fullsized":"2022-03-15T05:50:02.280352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:05:09.174014+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278568+0000","last_change":"2022-03-15T05:50:02.273042+0000","last_active":"2022-03-15T05:50:02.278568+0000","last_peered":"2022-03-15T05:50:02.278568+0000","last_clean":"2022-03-15T05:50:02.278568+0000","last_became_active":"2022-03-15T05:50:02.272528+0000","last_became_peered":"2022-03-15T05:50:02.272528+0000","last_unstale":"2022-03-15T05:50:02.278568+0000","last_undegraded":"2022-03-15T05:50:02.278568+0000","last_fullsized":"2022-03-15T05:50:02.278568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:38:32.868531+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278082+0000","last_change":"2022-03-15T05:50:02.270444+0000","last_active":"2022-03-15T05:50:02.278082+0000","last_peered":"2022-03-15T05:50:02.278082+0000","last_clean":"2022-03-15T05:50:02.278082+0000","last_became_active":"2022-03-15T05:50:02.270129+0000","last_became_peered":"2022-03-15T05:50:02.270129+0000","last_unstale":"2022-03-15T05:50:02.278082+0000","last_undegraded":"2022-03-15T05:50:02.278082+0000","last_fullsized":"2022-03-15T05:50:02.278082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:18:58.888559+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285050+0000","last_change":"2022-03-15T05:50:02.279990+0000","last_active":"2022-03-15T05:50:02.285050+0000","last_peered":"2022-03-15T05:50:02.285050+0000","last_clean":"2022-03-15T05:50:02.285050+0000","last_became_active":"2022-03-15T05:50:02.279527+0000","last_became_peered":"2022-03-15T05:50:02.279527+0000","last_unstale":"2022-03-15T05:50:02.285050+0000","last_undegraded":"2022-03-15T05:50:02.285050+0000","last_fullsized":"2022-03-15T05:50:02.285050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:10:41.298991+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267046+0000","last_change":"2022-03-15T05:50:01.757857+0000","last_active":"2022-03-15T05:50:02.267046+0000","last_peered":"2022-03-15T05:50:02.267046+0000","last_clean":"2022-03-15T05:50:02.267046+0000","last_became_active":"2022-03-15T05:50:01.757378+0000","last_became_peered":"2022-03-15T05:50:01.757378+0000","last_unstale":"2022-03-15T05:50:02.267046+0000","last_undegraded":"2022-03-15T05:50:02.267046+0000","last_fullsized":"2022-03-15T05:50:02.267046+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:29:24.796802+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278203+0000","last_change":"2022-03-15T05:50:02.274309+0000","last_active":"2022-03-15T05:50:02.278203+0000","last_peered":"2022-03-15T05:50:02.278203+0000","last_clean":"2022-03-15T05:50:02.278203+0000","last_became_active":"2022-03-15T05:50:02.273944+0000","last_became_peered":"2022-03-15T05:50:02.273944+0000","last_unstale":"2022-03-15T05:50:02.278203+0000","last_undegraded":"2022-03-15T05:50:02.278203+0000","last_fullsized":"2022-03-15T05:50:02.278203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:31:34.056283+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263479+0000","last_change":"2022-03-15T05:50:01.761316+0000","last_active":"2022-03-15T05:50:02.263479+0000","last_peered":"2022-03-15T05:50:02.263479+0000","last_clean":"2022-03-15T05:50:02.263479+0000","last_became_active":"2022-03-15T05:50:01.761064+0000","last_became_peered":"2022-03-15T05:50:01.761064+0000","last_unstale":"2022-03-15T05:50:02.263479+0000","last_undegraded":"2022-03-15T05:50:02.263479+0000","last_fullsized":"2022-03-15T05:50:02.263479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:08:39.825646+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280915+0000","last_change":"2022-03-15T05:50:02.278164+0000","last_active":"2022-03-15T05:50:02.280915+0000","last_peered":"2022-03-15T05:50:02.280915+0000","last_clean":"2022-03-15T05:50:02.280915+0000","last_became_active":"2022-03-15T05:50:02.277785+0000","last_became_peered":"2022-03-15T05:50:02.277785+0000","last_unstale":"2022-03-15T05:50:02.280915+0000","last_undegraded":"2022-03-15T05:50:02.280915+0000","last_fullsized":"2022-03-15T05:50:02.280915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:55:34.060331+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266525+0000","last_change":"2022-03-15T05:50:01.756648+0000","last_active":"2022-03-15T05:50:02.266525+0000","last_peered":"2022-03-15T05:50:02.266525+0000","last_clean":"2022-03-15T05:50:02.266525+0000","last_became_active":"2022-03-15T05:50:01.755611+0000","last_became_peered":"2022-03-15T05:50:01.755611+0000","last_unstale":"2022-03-15T05:50:02.266525+0000","last_undegraded":"2022-03-15T05:50:02.266525+0000","last_fullsized":"2022-03-15T05:50:02.266525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:34:52.558274+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281413+0000","last_change":"2022-03-15T05:50:02.273665+0000","last_active":"2022-03-15T05:50:02.281413+0000","last_peered":"2022-03-15T05:50:02.281413+0000","last_clean":"2022-03-15T05:50:02.281413+0000","last_became_active":"2022-03-15T05:50:02.273305+0000","last_became_peered":"2022-03-15T05:50:02.273305+0000","last_unstale":"2022-03-15T05:50:02.281413+0000","last_undegraded":"2022-03-15T05:50:02.281413+0000","last_fullsized":"2022-03-15T05:50:02.281413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:09:21.723908+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.268432+0000","last_change":"2022-03-15T05:50:01.766117+0000","last_active":"2022-03-15T05:50:02.268432+0000","last_peered":"2022-03-15T05:50:02.268432+0000","last_clean":"2022-03-15T05:50:02.268432+0000","last_became_active":"2022-03-15T05:50:01.765787+0000","last_became_peered":"2022-03-15T05:50:01.765787+0000","last_unstale":"2022-03-15T05:50:02.268432+0000","last_undegraded":"2022-03-15T05:50:02.268432+0000","last_fullsized":"2022-03-15T05:50:02.268432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:01:30.570219+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282069+0000","last_change":"2022-03-15T05:50:02.281022+0000","last_active":"2022-03-15T05:50:02.282069+0000","last_peered":"2022-03-15T05:50:02.282069+0000","last_clean":"2022-03-15T05:50:02.282069+0000","last_became_active":"2022-03-15T05:50:02.280637+0000","last_became_peered":"2022-03-15T05:50:02.280637+0000","last_unstale":"2022-03-15T05:50:02.282069+0000","last_undegraded":"2022-03-15T05:50:02.282069+0000","last_fullsized":"2022-03-15T05:50:02.282069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:22:20.683447+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.257650+0000","last_change":"2022-03-15T05:50:01.761879+0000","last_active":"2022-03-15T05:50:02.257650+0000","last_peered":"2022-03-15T05:50:02.257650+0000","last_clean":"2022-03-15T05:50:02.257650+0000","last_became_active":"2022-03-15T05:50:01.761612+0000","last_became_peered":"2022-03-15T05:50:01.761612+0000","last_unstale":"2022-03-15T05:50:02.257650+0000","last_undegraded":"2022-03-15T05:50:02.257650+0000","last_fullsized":"2022-03-15T05:50:02.257650+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:48:49.655032+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282022+0000","last_change":"2022-03-15T05:50:02.280735+0000","last_active":"2022-03-15T05:50:02.282022+0000","last_peered":"2022-03-15T05:50:02.282022+0000","last_clean":"2022-03-15T05:50:02.282022+0000","last_became_active":"2022-03-15T05:50:02.280417+0000","last_became_peered":"2022-03-15T05:50:02.280417+0000","last_unstale":"2022-03-15T05:50:02.282022+0000","last_undegraded":"2022-03-15T05:50:02.282022+0000","last_fullsized":"2022-03-15T05:50:02.282022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:02:09.355535+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.262913+0000","last_change":"2022-03-15T05:50:01.763468+0000","last_active":"2022-03-15T05:50:02.262913+0000","last_peered":"2022-03-15T05:50:02.262913+0000","last_clean":"2022-03-15T05:50:02.262913+0000","last_became_active":"2022-03-15T05:50:01.763046+0000","last_became_peered":"2022-03-15T05:50:01.763046+0000","last_unstale":"2022-03-15T05:50:02.262913+0000","last_undegraded":"2022-03-15T05:50:02.262913+0000","last_fullsized":"2022-03-15T05:50:02.262913+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:02:04.856436+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.276334+0000","last_change":"2022-03-15T05:50:02.272492+0000","last_active":"2022-03-15T05:50:02.276334+0000","last_peered":"2022-03-15T05:50:02.276334+0000","last_clean":"2022-03-15T05:50:02.276334+0000","last_became_active":"2022-03-15T05:50:02.266942+0000","last_became_peered":"2022-03-15T05:50:02.266942+0000","last_unstale":"2022-03-15T05:50:02.276334+0000","last_undegraded":"2022-03-15T05:50:02.276334+0000","last_fullsized":"2022-03-15T05:50:02.276334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:48:30.216948+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'6","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.267260+0000","last_change":"2022-03-15T05:50:01.767583+0000","last_active":"2022-03-15T05:50:07.267260+0000","last_peered":"2022-03-15T05:50:07.267260+0000","last_clean":"2022-03-15T05:50:07.267260+0000","last_became_active":"2022-03-15T05:50:01.766773+0000","last_became_peered":"2022-03-15T05:50:01.766773+0000","last_unstale":"2022-03-15T05:50:07.267260+0000","last_undegraded":"2022-03-15T05:50:07.267260+0000","last_fullsized":"2022-03-15T05:50:07.267260+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:23:44.248528+0000","stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278156+0000","last_change":"2022-03-15T05:50:02.271456+0000","last_active":"2022-03-15T05:50:02.278156+0000","last_peered":"2022-03-15T05:50:02.278156+0000","last_clean":"2022-03-15T05:50:02.278156+0000","last_became_active":"2022-03-15T05:50:02.270402+0000","last_became_peered":"2022-03-15T05:50:02.270402+0000","last_unstale":"2022-03-15T05:50:02.278156+0000","last_undegraded":"2022-03-15T05:50:02.278156+0000","last_fullsized":"2022-03-15T05:50:02.278156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:29:17.756689+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.265537+0000","last_change":"2022-03-15T05:50:01.768867+0000","last_active":"2022-03-15T05:50:07.265537+0000","last_peered":"2022-03-15T05:50:07.265537+0000","last_clean":"2022-03-15T05:50:07.265537+0000","last_became_active":"2022-03-15T05:50:01.768586+0000","last_became_peered":"2022-03-15T05:50:01.768586+0000","last_unstale":"2022-03-15T05:50:07.265537+0000","last_undegraded":"2022-03-15T05:50:07.265537+0000","last_fullsized":"2022-03-15T05:50:07.265537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:54:20.464304+0000","stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279217+0000","last_change":"2022-03-15T05:50:02.277330+0000","last_active":"2022-03-15T05:50:02.279217+0000","last_peered":"2022-03-15T05:50:02.279217+0000","last_clean":"2022-03-15T05:50:02.279217+0000","last_became_active":"2022-03-15T05:50:02.276873+0000","last_became_peered":"2022-03-15T05:50:02.276873+0000","last_unstale":"2022-03-15T05:50:02.279217+0000","last_undegraded":"2022-03-15T05:50:02.279217+0000","last_fullsized":"2022-03-15T05:50:02.279217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:24:11.044313+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266707+0000","last_change":"2022-03-15T05:50:01.768784+0000","last_active":"2022-03-15T05:50:02.266707+0000","last_peered":"2022-03-15T05:50:02.266707+0000","last_clean":"2022-03-15T05:50:02.266707+0000","last_became_active":"2022-03-15T05:50:01.768446+0000","last_became_peered":"2022-03-15T05:50:01.768446+0000","last_unstale":"2022-03-15T05:50:02.266707+0000","last_undegraded":"2022-03-15T05:50:02.266707+0000","last_fullsized":"2022-03-15T05:50:02.266707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:17:30.808770+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285030+0000","last_change":"2022-03-15T05:50:02.279791+0000","last_active":"2022-03-15T05:50:02.285030+0000","last_peered":"2022-03-15T05:50:02.285030+0000","last_clean":"2022-03-15T05:50:02.285030+0000","last_became_active":"2022-03-15T05:50:02.279172+0000","last_became_peered":"2022-03-15T05:50:02.279172+0000","last_unstale":"2022-03-15T05:50:02.285030+0000","last_undegraded":"2022-03-15T05:50:02.285030+0000","last_fullsized":"2022-03-15T05:50:02.285030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:06:01.717047+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261139+0000","last_change":"2022-03-15T05:50:01.765934+0000","last_active":"2022-03-15T05:50:02.261139+0000","last_peered":"2022-03-15T05:50:02.261139+0000","last_clean":"2022-03-15T05:50:02.261139+0000","last_became_active":"2022-03-15T05:50:01.765593+0000","last_became_peered":"2022-03-15T05:50:01.765593+0000","last_unstale":"2022-03-15T05:50:02.261139+0000","last_undegraded":"2022-03-15T05:50:02.261139+0000","last_fullsized":"2022-03-15T05:50:02.261139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:17:58.343945+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273584+0000","last_change":"2022-03-15T05:50:02.271214+0000","last_active":"2022-03-15T05:50:02.273584+0000","last_peered":"2022-03-15T05:50:02.273584+0000","last_clean":"2022-03-15T05:50:02.273584+0000","last_became_active":"2022-03-15T05:50:02.270503+0000","last_became_peered":"2022-03-15T05:50:02.270503+0000","last_unstale":"2022-03-15T05:50:02.273584+0000","last_undegraded":"2022-03-15T05:50:02.273584+0000","last_fullsized":"2022-03-15T05:50:02.273584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:46:34.707474+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261962+0000","last_change":"2022-03-15T05:50:01.760128+0000","last_active":"2022-03-15T05:50:02.261962+0000","last_peered":"2022-03-15T05:50:02.261962+0000","last_clean":"2022-03-15T05:50:02.261962+0000","last_became_active":"2022-03-15T05:50:01.759822+0000","last_became_peered":"2022-03-15T05:50:01.759822+0000","last_unstale":"2022-03-15T05:50:02.261962+0000","last_undegraded":"2022-03-15T05:50:02.261962+0000","last_fullsized":"2022-03-15T05:50:02.261962+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:18:48.265357+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280983+0000","last_change":"2022-03-15T05:50:02.279712+0000","last_active":"2022-03-15T05:50:02.280983+0000","last_peered":"2022-03-15T05:50:02.280983+0000","last_clean":"2022-03-15T05:50:02.280983+0000","last_became_active":"2022-03-15T05:50:02.279212+0000","last_became_peered":"2022-03-15T05:50:02.279212+0000","last_unstale":"2022-03-15T05:50:02.280983+0000","last_undegraded":"2022-03-15T05:50:02.280983+0000","last_fullsized":"2022-03-15T05:50:02.280983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:19:44.101895+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.260222+0000","last_change":"2022-03-15T05:50:01.758101+0000","last_active":"2022-03-15T05:50:02.260222+0000","last_peered":"2022-03-15T05:50:02.260222+0000","last_clean":"2022-03-15T05:50:02.260222+0000","last_became_active":"2022-03-15T05:50:01.757825+0000","last_became_peered":"2022-03-15T05:50:01.757825+0000","last_unstale":"2022-03-15T05:50:02.260222+0000","last_undegraded":"2022-03-15T05:50:02.260222+0000","last_fullsized":"2022-03-15T05:50:02.260222+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:17:42.303241+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281448+0000","last_change":"2022-03-15T05:50:02.267337+0000","last_active":"2022-03-15T05:50:02.281448+0000","last_peered":"2022-03-15T05:50:02.281448+0000","last_clean":"2022-03-15T05:50:02.281448+0000","last_became_active":"2022-03-15T05:50:02.267082+0000","last_became_peered":"2022-03-15T05:50:02.267082+0000","last_unstale":"2022-03-15T05:50:02.281448+0000","last_undegraded":"2022-03-15T05:50:02.281448+0000","last_fullsized":"2022-03-15T05:50:02.281448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:28:10.148060+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.265537+0000","last_change":"2022-03-15T05:50:01.766324+0000","last_active":"2022-03-15T05:50:07.265537+0000","last_peered":"2022-03-15T05:50:07.265537+0000","last_clean":"2022-03-15T05:50:07.265537+0000","last_became_active":"2022-03-15T05:50:01.766008+0000","last_became_peered":"2022-03-15T05:50:01.766008+0000","last_unstale":"2022-03-15T05:50:07.265537+0000","last_undegraded":"2022-03-15T05:50:07.265537+0000","last_fullsized":"2022-03-15T05:50:07.265537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:00:37.206705+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280289+0000","last_change":"2022-03-15T05:50:02.276334+0000","last_active":"2022-03-15T05:50:02.280289+0000","last_peered":"2022-03-15T05:50:02.280289+0000","last_clean":"2022-03-15T05:50:02.280289+0000","last_became_active":"2022-03-15T05:50:02.276030+0000","last_became_peered":"2022-03-15T05:50:02.276030+0000","last_unstale":"2022-03-15T05:50:02.280289+0000","last_undegraded":"2022-03-15T05:50:02.280289+0000","last_fullsized":"2022-03-15T05:50:02.280289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:24:56.245923+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:03.259992+0000","last_change":"2022-03-15T05:50:01.771270+0000","last_active":"2022-03-15T05:50:03.259992+0000","last_peered":"2022-03-15T05:50:03.259992+0000","last_clean":"2022-03-15T05:50:03.259992+0000","last_became_active":"2022-03-15T05:50:01.770985+0000","last_became_peered":"2022-03-15T05:50:01.770985+0000","last_unstale":"2022-03-15T05:50:03.259992+0000","last_undegraded":"2022-03-15T05:50:03.259992+0000","last_fullsized":"2022-03-15T05:50:03.259992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:28:26.138901+0000","stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277231+0000","last_change":"2022-03-15T05:50:02.270661+0000","last_active":"2022-03-15T05:50:02.277231+0000","last_peered":"2022-03-15T05:50:02.277231+0000","last_clean":"2022-03-15T05:50:02.277231+0000","last_became_active":"2022-03-15T05:50:02.270338+0000","last_became_peered":"2022-03-15T05:50:02.270338+0000","last_unstale":"2022-03-15T05:50:02.277231+0000","last_undegraded":"2022-03-15T05:50:02.277231+0000","last_fullsized":"2022-03-15T05:50:02.277231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:07:13.970018+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261651+0000","last_change":"2022-03-15T05:50:01.760891+0000","last_active":"2022-03-15T05:50:02.261651+0000","last_peered":"2022-03-15T05:50:02.261651+0000","last_clean":"2022-03-15T05:50:02.261651+0000","last_became_active":"2022-03-15T05:50:01.760552+0000","last_became_peered":"2022-03-15T05:50:01.760552+0000","last_unstale":"2022-03-15T05:50:02.261651+0000","last_undegraded":"2022-03-15T05:50:02.261651+0000","last_fullsized":"2022-03-15T05:50:02.261651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:10:36.649419+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278969+0000","last_change":"2022-03-15T05:50:02.277381+0000","last_active":"2022-03-15T05:50:02.278969+0000","last_peered":"2022-03-15T05:50:02.278969+0000","last_clean":"2022-03-15T05:50:02.278969+0000","last_became_active":"2022-03-15T05:50:02.277113+0000","last_became_peered":"2022-03-15T05:50:02.277113+0000","last_unstale":"2022-03-15T05:50:02.278969+0000","last_undegraded":"2022-03-15T05:50:02.278969+0000","last_fullsized":"2022-03-15T05:50:02.278969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:20:07.922465+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.258968+0000","last_change":"2022-03-15T05:50:01.757991+0000","last_active":"2022-03-15T05:50:02.258968+0000","last_peered":"2022-03-15T05:50:02.258968+0000","last_clean":"2022-03-15T05:50:02.258968+0000","last_became_active":"2022-03-15T05:50:01.757651+0000","last_became_peered":"2022-03-15T05:50:01.757651+0000","last_unstale":"2022-03-15T05:50:02.258968+0000","last_undegraded":"2022-03-15T05:50:02.258968+0000","last_fullsized":"2022-03-15T05:50:02.258968+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:17:51.775038+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278650+0000","last_change":"2022-03-15T05:50:02.277017+0000","last_active":"2022-03-15T05:50:02.278650+0000","last_peered":"2022-03-15T05:50:02.278650+0000","last_clean":"2022-03-15T05:50:02.278650+0000","last_became_active":"2022-03-15T05:50:02.276718+0000","last_became_peered":"2022-03-15T05:50:02.276718+0000","last_unstale":"2022-03-15T05:50:02.278650+0000","last_undegraded":"2022-03-15T05:50:02.278650+0000","last_fullsized":"2022-03-15T05:50:02.278650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:56:31.659289+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261713+0000","last_change":"2022-03-15T05:50:01.764679+0000","last_active":"2022-03-15T05:50:02.261713+0000","last_peered":"2022-03-15T05:50:02.261713+0000","last_clean":"2022-03-15T05:50:02.261713+0000","last_became_active":"2022-03-15T05:50:01.761848+0000","last_became_peered":"2022-03-15T05:50:01.761848+0000","last_unstale":"2022-03-15T05:50:02.261713+0000","last_undegraded":"2022-03-15T05:50:02.261713+0000","last_fullsized":"2022-03-15T05:50:02.261713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:14:14.162973+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286066+0000","last_change":"2022-03-15T05:50:02.283961+0000","last_active":"2022-03-15T05:50:02.286066+0000","last_peered":"2022-03-15T05:50:02.286066+0000","last_clean":"2022-03-15T05:50:02.286066+0000","last_became_active":"2022-03-15T05:50:02.283237+0000","last_became_peered":"2022-03-15T05:50:02.283237+0000","last_unstale":"2022-03-15T05:50:02.286066+0000","last_undegraded":"2022-03-15T05:50:02.286066+0000","last_fullsized":"2022-03-15T05:50:02.286066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:42:49.764129+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261036+0000","last_change":"2022-03-15T05:50:01.767200+0000","last_active":"2022-03-15T05:50:02.261036+0000","last_peered":"2022-03-15T05:50:02.261036+0000","last_clean":"2022-03-15T05:50:02.261036+0000","last_became_active":"2022-03-15T05:50:01.766581+0000","last_became_peered":"2022-03-15T05:50:01.766581+0000","last_unstale":"2022-03-15T05:50:02.261036+0000","last_undegraded":"2022-03-15T05:50:02.261036+0000","last_fullsized":"2022-03-15T05:50:02.261036+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:58:11.088344+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275948+0000","last_change":"2022-03-15T05:50:02.270649+0000","last_active":"2022-03-15T05:50:02.275948+0000","last_peered":"2022-03-15T05:50:02.275948+0000","last_clean":"2022-03-15T05:50:02.275948+0000","last_became_active":"2022-03-15T05:50:02.270308+0000","last_became_peered":"2022-03-15T05:50:02.270308+0000","last_unstale":"2022-03-15T05:50:02.275948+0000","last_undegraded":"2022-03-15T05:50:02.275948+0000","last_fullsized":"2022-03-15T05:50:02.275948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:18:01.692755+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263279+0000","last_change":"2022-03-15T05:50:01.758464+0000","last_active":"2022-03-15T05:50:02.263279+0000","last_peered":"2022-03-15T05:50:02.263279+0000","last_clean":"2022-03-15T05:50:02.263279+0000","last_became_active":"2022-03-15T05:50:01.757936+0000","last_became_peered":"2022-03-15T05:50:01.757936+0000","last_unstale":"2022-03-15T05:50:02.263279+0000","last_undegraded":"2022-03-15T05:50:02.263279+0000","last_fullsized":"2022-03-15T05:50:02.263279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:44:19.373542+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278115+0000","last_change":"2022-03-15T05:50:02.270500+0000","last_active":"2022-03-15T05:50:02.278115+0000","last_peered":"2022-03-15T05:50:02.278115+0000","last_clean":"2022-03-15T05:50:02.278115+0000","last_became_active":"2022-03-15T05:50:02.270165+0000","last_became_peered":"2022-03-15T05:50:02.270165+0000","last_unstale":"2022-03-15T05:50:02.278115+0000","last_undegraded":"2022-03-15T05:50:02.278115+0000","last_fullsized":"2022-03-15T05:50:02.278115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:20:11.113002+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267755+0000","last_change":"2022-03-15T05:49:56.006265+0000","last_active":"2022-03-15T05:50:02.267755+0000","last_peered":"2022-03-15T05:50:02.267755+0000","last_clean":"2022-03-15T05:50:02.267755+0000","last_became_active":"2022-03-15T05:49:56.005945+0000","last_became_peered":"2022-03-15T05:49:56.005945+0000","last_unstale":"2022-03-15T05:50:02.267755+0000","last_undegraded":"2022-03-15T05:50:02.267755+0000","last_fullsized":"2022-03-15T05:50:02.267755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T05:59:10.545960+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.256784+0000","last_change":"2022-03-15T05:50:01.756552+0000","last_active":"2022-03-15T05:50:02.256784+0000","last_peered":"2022-03-15T05:50:02.256784+0000","last_clean":"2022-03-15T05:50:02.256784+0000","last_became_active":"2022-03-15T05:50:01.755731+0000","last_became_peered":"2022-03-15T05:50:01.755731+0000","last_unstale":"2022-03-15T05:50:02.256784+0000","last_undegraded":"2022-03-15T05:50:02.256784+0000","last_fullsized":"2022-03-15T05:50:02.256784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:20:06.863246+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277227+0000","last_change":"2022-03-15T05:50:02.271788+0000","last_active":"2022-03-15T05:50:02.277227+0000","last_peered":"2022-03-15T05:50:02.277227+0000","last_clean":"2022-03-15T05:50:02.277227+0000","last_became_active":"2022-03-15T05:50:02.271479+0000","last_became_peered":"2022-03-15T05:50:02.271479+0000","last_unstale":"2022-03-15T05:50:02.277227+0000","last_undegraded":"2022-03-15T05:50:02.277227+0000","last_fullsized":"2022-03-15T05:50:02.277227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:50:05.553818+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261866+0000","last_change":"2022-03-15T05:49:56.006179+0000","last_active":"2022-03-15T05:50:02.261866+0000","last_peered":"2022-03-15T05:50:02.261866+0000","last_clean":"2022-03-15T05:50:02.261866+0000","last_became_active":"2022-03-15T05:49:56.005909+0000","last_became_peered":"2022-03-15T05:49:56.005909+0000","last_unstale":"2022-03-15T05:50:02.261866+0000","last_undegraded":"2022-03-15T05:50:02.261866+0000","last_fullsized":"2022-03-15T05:50:02.261866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:24:44.215515+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.262943+0000","last_change":"2022-03-15T05:50:01.764346+0000","last_active":"2022-03-15T05:50:02.262943+0000","last_peered":"2022-03-15T05:50:02.262943+0000","last_clean":"2022-03-15T05:50:02.262943+0000","last_became_active":"2022-03-15T05:50:01.763997+0000","last_became_peered":"2022-03-15T05:50:01.763997+0000","last_unstale":"2022-03-15T05:50:02.262943+0000","last_undegraded":"2022-03-15T05:50:02.262943+0000","last_fullsized":"2022-03-15T05:50:02.262943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:50:52.655627+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279198+0000","last_change":"2022-03-15T05:50:02.276942+0000","last_active":"2022-03-15T05:50:02.279198+0000","last_peered":"2022-03-15T05:50:02.279198+0000","last_clean":"2022-03-15T05:50:02.279198+0000","last_became_active":"2022-03-15T05:50:02.276353+0000","last_became_peered":"2022-03-15T05:50:02.276353+0000","last_unstale":"2022-03-15T05:50:02.279198+0000","last_undegraded":"2022-03-15T05:50:02.279198+0000","last_fullsized":"2022-03-15T05:50:02.279198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:30:47.020786+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.259035+0000","last_change":"2022-03-15T05:49:55.717507+0000","last_active":"2022-03-15T05:50:02.259035+0000","last_peered":"2022-03-15T05:50:02.259035+0000","last_clean":"2022-03-15T05:50:02.259035+0000","last_became_active":"2022-03-15T05:49:55.717125+0000","last_became_peered":"2022-03-15T05:49:55.717125+0000","last_unstale":"2022-03-15T05:50:02.259035+0000","last_undegraded":"2022-03-15T05:50:02.259035+0000","last_fullsized":"2022-03-15T05:50:02.259035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:01:26.511571+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266522+0000","last_change":"2022-03-15T05:50:01.756925+0000","last_active":"2022-03-15T05:50:02.266522+0000","last_peered":"2022-03-15T05:50:02.266522+0000","last_clean":"2022-03-15T05:50:02.266522+0000","last_became_active":"2022-03-15T05:50:01.756195+0000","last_became_peered":"2022-03-15T05:50:01.756195+0000","last_unstale":"2022-03-15T05:50:02.266522+0000","last_undegraded":"2022-03-15T05:50:02.266522+0000","last_fullsized":"2022-03-15T05:50:02.266522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:37:07.377792+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277317+0000","last_change":"2022-03-15T05:50:02.272291+0000","last_active":"2022-03-15T05:50:02.277317+0000","last_peered":"2022-03-15T05:50:02.277317+0000","last_clean":"2022-03-15T05:50:02.277317+0000","last_became_active":"2022-03-15T05:50:02.271963+0000","last_became_peered":"2022-03-15T05:50:02.271963+0000","last_unstale":"2022-03-15T05:50:02.277317+0000","last_undegraded":"2022-03-15T05:50:02.277317+0000","last_fullsized":"2022-03-15T05:50:02.277317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:39:02.228387+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.264335+0000","last_change":"2022-03-15T05:49:55.714924+0000","last_active":"2022-03-15T05:50:02.264335+0000","last_peered":"2022-03-15T05:50:02.264335+0000","last_clean":"2022-03-15T05:50:02.264335+0000","last_became_active":"2022-03-15T05:49:55.714704+0000","last_became_peered":"2022-03-15T05:49:55.714704+0000","last_unstale":"2022-03-15T05:50:02.264335+0000","last_undegraded":"2022-03-15T05:50:02.264335+0000","last_fullsized":"2022-03-15T05:50:02.264335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:17:23.776392+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261862+0000","last_change":"2022-03-15T05:49:48.418992+0000","last_active":"2022-03-15T05:50:02.261862+0000","last_peered":"2022-03-15T05:50:02.261862+0000","last_clean":"2022-03-15T05:50:02.261862+0000","last_became_active":"2022-03-15T05:49:48.417864+0000","last_became_peered":"2022-03-15T05:49:48.417864+0000","last_unstale":"2022-03-15T05:50:02.261862+0000","last_undegraded":"2022-03-15T05:50:02.261862+0000","last_fullsized":"2022-03-15T05:50:02.261862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:47.305366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:47.305366+0000","last_clean_scrub_stamp":"2022-03-15T05:49:47.305366+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:06:48.812663+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.265735+0000","last_change":"2022-03-15T05:50:01.768622+0000","last_active":"2022-03-15T05:50:02.265735+0000","last_peered":"2022-03-15T05:50:02.265735+0000","last_clean":"2022-03-15T05:50:02.265735+0000","last_became_active":"2022-03-15T05:50:01.768270+0000","last_became_peered":"2022-03-15T05:50:01.768270+0000","last_unstale":"2022-03-15T05:50:02.265735+0000","last_undegraded":"2022-03-15T05:50:02.265735+0000","last_fullsized":"2022-03-15T05:50:02.265735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:53:03.610048+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286021+0000","last_change":"2022-03-15T05:50:02.283485+0000","last_active":"2022-03-15T05:50:02.286021+0000","last_peered":"2022-03-15T05:50:02.286021+0000","last_clean":"2022-03-15T05:50:02.286021+0000","last_became_active":"2022-03-15T05:50:02.282868+0000","last_became_peered":"2022-03-15T05:50:02.282868+0000","last_unstale":"2022-03-15T05:50:02.286021+0000","last_undegraded":"2022-03-15T05:50:02.286021+0000","last_fullsized":"2022-03-15T05:50:02.286021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:41:46.412779+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261606+0000","last_change":"2022-03-15T05:49:55.717054+0000","last_active":"2022-03-15T05:50:02.261606+0000","last_peered":"2022-03-15T05:50:02.261606+0000","last_clean":"2022-03-15T05:50:02.261606+0000","last_became_active":"2022-03-15T05:49:55.716665+0000","last_became_peered":"2022-03-15T05:49:55.716665+0000","last_unstale":"2022-03-15T05:50:02.261606+0000","last_undegraded":"2022-03-15T05:50:02.261606+0000","last_fullsized":"2022-03-15T05:50:02.261606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:39:40.811968+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263842+0000","last_change":"2022-03-15T05:50:01.759408+0000","last_active":"2022-03-15T05:50:02.263842+0000","last_peered":"2022-03-15T05:50:02.263842+0000","last_clean":"2022-03-15T05:50:02.263842+0000","last_became_active":"2022-03-15T05:50:01.759087+0000","last_became_peered":"2022-03-15T05:50:01.759087+0000","last_unstale":"2022-03-15T05:50:02.263842+0000","last_undegraded":"2022-03-15T05:50:02.263842+0000","last_fullsized":"2022-03-15T05:50:02.263842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:16:33.815600+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273561+0000","last_change":"2022-03-15T05:50:02.270677+0000","last_active":"2022-03-15T05:50:02.273561+0000","last_peered":"2022-03-15T05:50:02.273561+0000","last_clean":"2022-03-15T05:50:02.273561+0000","last_became_active":"2022-03-15T05:50:02.270124+0000","last_became_peered":"2022-03-15T05:50:02.270124+0000","last_unstale":"2022-03-15T05:50:02.273561+0000","last_undegraded":"2022-03-15T05:50:02.273561+0000","last_fullsized":"2022-03-15T05:50:02.273561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:08:06.976250+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.264706+0000","last_change":"2022-03-15T05:49:55.717051+0000","last_active":"2022-03-15T05:50:02.264706+0000","last_peered":"2022-03-15T05:50:02.264706+0000","last_clean":"2022-03-15T05:50:02.264706+0000","last_became_active":"2022-03-15T05:49:55.716645+0000","last_became_peered":"2022-03-15T05:49:55.716645+0000","last_unstale":"2022-03-15T05:50:02.264706+0000","last_undegraded":"2022-03-15T05:50:02.264706+0000","last_fullsized":"2022-03-15T05:50:02.264706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:30:50.088264+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.265664+0000","last_change":"2022-03-15T05:50:01.751284+0000","last_active":"2022-03-15T05:50:02.265664+0000","last_peered":"2022-03-15T05:50:02.265664+0000","last_clean":"2022-03-15T05:50:02.265664+0000","last_became_active":"2022-03-15T05:50:01.750703+0000","last_became_peered":"2022-03-15T05:50:01.750703+0000","last_unstale":"2022-03-15T05:50:02.265664+0000","last_undegraded":"2022-03-15T05:50:02.265664+0000","last_fullsized":"2022-03-15T05:50:02.265664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:38:23.932929+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277357+0000","last_change":"2022-03-15T05:50:02.272088+0000","last_active":"2022-03-15T05:50:02.277357+0000","last_peered":"2022-03-15T05:50:02.277357+0000","last_clean":"2022-03-15T05:50:02.277357+0000","last_became_active":"2022-03-15T05:50:02.271791+0000","last_became_peered":"2022-03-15T05:50:02.271791+0000","last_unstale":"2022-03-15T05:50:02.277357+0000","last_undegraded":"2022-03-15T05:50:02.277357+0000","last_fullsized":"2022-03-15T05:50:02.277357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:47:55.992221+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267595+0000","last_change":"2022-03-15T05:50:01.760181+0000","last_active":"2022-03-15T05:50:02.267595+0000","last_peered":"2022-03-15T05:50:02.267595+0000","last_clean":"2022-03-15T05:50:02.267595+0000","last_became_active":"2022-03-15T05:50:01.758933+0000","last_became_peered":"2022-03-15T05:50:01.758933+0000","last_unstale":"2022-03-15T05:50:02.267595+0000","last_undegraded":"2022-03-15T05:50:02.267595+0000","last_fullsized":"2022-03-15T05:50:02.267595+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:07:34.261671+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266242+0000","last_change":"2022-03-15T05:49:56.021984+0000","last_active":"2022-03-15T05:50:02.266242+0000","last_peered":"2022-03-15T05:50:02.266242+0000","last_clean":"2022-03-15T05:50:02.266242+0000","last_became_active":"2022-03-15T05:49:56.021731+0000","last_became_peered":"2022-03-15T05:49:56.021731+0000","last_unstale":"2022-03-15T05:50:02.266242+0000","last_undegraded":"2022-03-15T05:50:02.266242+0000","last_fullsized":"2022-03-15T05:50:02.266242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:28:10.949766+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284752+0000","last_change":"2022-03-15T05:50:02.283078+0000","last_active":"2022-03-15T05:50:02.284752+0000","last_peered":"2022-03-15T05:50:02.284752+0000","last_clean":"2022-03-15T05:50:02.284752+0000","last_became_active":"2022-03-15T05:50:02.282773+0000","last_became_peered":"2022-03-15T05:50:02.282773+0000","last_unstale":"2022-03-15T05:50:02.284752+0000","last_undegraded":"2022-03-15T05:50:02.284752+0000","last_fullsized":"2022-03-15T05:50:02.284752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:30:20.154884+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261311+0000","last_change":"2022-03-15T05:49:56.021748+0000","last_active":"2022-03-15T05:50:02.261311+0000","last_peered":"2022-03-15T05:50:02.261311+0000","last_clean":"2022-03-15T05:50:02.261311+0000","last_became_active":"2022-03-15T05:49:56.021377+0000","last_became_peered":"2022-03-15T05:49:56.021377+0000","last_unstale":"2022-03-15T05:50:02.261311+0000","last_undegraded":"2022-03-15T05:50:02.261311+0000","last_fullsized":"2022-03-15T05:50:02.261311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:26:22.203948+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266443+0000","last_change":"2022-03-15T05:50:01.758476+0000","last_active":"2022-03-15T05:50:02.266443+0000","last_peered":"2022-03-15T05:50:02.266443+0000","last_clean":"2022-03-15T05:50:02.266443+0000","last_became_active":"2022-03-15T05:50:01.757859+0000","last_became_peered":"2022-03-15T05:50:01.757859+0000","last_unstale":"2022-03-15T05:50:02.266443+0000","last_undegraded":"2022-03-15T05:50:02.266443+0000","last_fullsized":"2022-03-15T05:50:02.266443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:18:49.740446+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279752+0000","last_change":"2022-03-15T05:50:02.271202+0000","last_active":"2022-03-15T05:50:02.279752+0000","last_peered":"2022-03-15T05:50:02.279752+0000","last_clean":"2022-03-15T05:50:02.279752+0000","last_became_active":"2022-03-15T05:50:02.270717+0000","last_became_peered":"2022-03-15T05:50:02.270717+0000","last_unstale":"2022-03-15T05:50:02.279752+0000","last_undegraded":"2022-03-15T05:50:02.279752+0000","last_fullsized":"2022-03-15T05:50:02.279752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:57:17.654890+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266030+0000","last_change":"2022-03-15T05:50:01.768300+0000","last_active":"2022-03-15T05:50:02.266030+0000","last_peered":"2022-03-15T05:50:02.266030+0000","last_clean":"2022-03-15T05:50:02.266030+0000","last_became_active":"2022-03-15T05:50:01.767955+0000","last_became_peered":"2022-03-15T05:50:01.767955+0000","last_unstale":"2022-03-15T05:50:02.266030+0000","last_undegraded":"2022-03-15T05:50:02.266030+0000","last_fullsized":"2022-03-15T05:50:02.266030+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:10:41.738813+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280244+0000","last_change":"2022-03-15T05:50:02.276173+0000","last_active":"2022-03-15T05:50:02.280244+0000","last_peered":"2022-03-15T05:50:02.280244+0000","last_clean":"2022-03-15T05:50:02.280244+0000","last_became_active":"2022-03-15T05:50:02.275805+0000","last_became_peered":"2022-03-15T05:50:02.275805+0000","last_unstale":"2022-03-15T05:50:02.280244+0000","last_undegraded":"2022-03-15T05:50:02.280244+0000","last_fullsized":"2022-03-15T05:50:02.280244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:20:32.284452+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.260815+0000","last_change":"2022-03-15T05:50:01.769303+0000","last_active":"2022-03-15T05:50:02.260815+0000","last_peered":"2022-03-15T05:50:02.260815+0000","last_clean":"2022-03-15T05:50:02.260815+0000","last_became_active":"2022-03-15T05:50:01.768420+0000","last_became_peered":"2022-03-15T05:50:01.768420+0000","last_unstale":"2022-03-15T05:50:02.260815+0000","last_undegraded":"2022-03-15T05:50:02.260815+0000","last_fullsized":"2022-03-15T05:50:02.260815+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:52:53.780299+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275161+0000","last_change":"2022-03-15T05:50:02.269010+0000","last_active":"2022-03-15T05:50:02.275161+0000","last_peered":"2022-03-15T05:50:02.275161+0000","last_clean":"2022-03-15T05:50:02.275161+0000","last_became_active":"2022-03-15T05:50:02.268702+0000","last_became_peered":"2022-03-15T05:50:02.268702+0000","last_unstale":"2022-03-15T05:50:02.275161+0000","last_undegraded":"2022-03-15T05:50:02.275161+0000","last_fullsized":"2022-03-15T05:50:02.275161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:21:36.546324+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.265743+0000","last_change":"2022-03-15T05:50:01.769060+0000","last_active":"2022-03-15T05:50:07.265743+0000","last_peered":"2022-03-15T05:50:07.265743+0000","last_clean":"2022-03-15T05:50:07.265743+0000","last_became_active":"2022-03-15T05:50:01.768832+0000","last_became_peered":"2022-03-15T05:50:01.768832+0000","last_unstale":"2022-03-15T05:50:07.265743+0000","last_undegraded":"2022-03-15T05:50:07.265743+0000","last_fullsized":"2022-03-15T05:50:07.265743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:08:34.598986+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277210+0000","last_change":"2022-03-15T05:50:02.269955+0000","last_active":"2022-03-15T05:50:02.277210+0000","last_peered":"2022-03-15T05:50:02.277210+0000","last_clean":"2022-03-15T05:50:02.277210+0000","last_became_active":"2022-03-15T05:50:02.268808+0000","last_became_peered":"2022-03-15T05:50:02.268808+0000","last_unstale":"2022-03-15T05:50:02.277210+0000","last_undegraded":"2022-03-15T05:50:02.277210+0000","last_fullsized":"2022-03-15T05:50:02.277210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:42:50.905588+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267659+0000","last_change":"2022-03-15T05:50:01.758736+0000","last_active":"2022-03-15T05:50:02.267659+0000","last_peered":"2022-03-15T05:50:02.267659+0000","last_clean":"2022-03-15T05:50:02.267659+0000","last_became_active":"2022-03-15T05:50:01.758333+0000","last_became_peered":"2022-03-15T05:50:01.758333+0000","last_unstale":"2022-03-15T05:50:02.267659+0000","last_undegraded":"2022-03-15T05:50:02.267659+0000","last_fullsized":"2022-03-15T05:50:02.267659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:58:43.148420+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277947+0000","last_change":"2022-03-15T05:50:02.269606+0000","last_active":"2022-03-15T05:50:02.277947+0000","last_peered":"2022-03-15T05:50:02.277947+0000","last_clean":"2022-03-15T05:50:02.277947+0000","last_became_active":"2022-03-15T05:50:02.268919+0000","last_became_peered":"2022-03-15T05:50:02.268919+0000","last_unstale":"2022-03-15T05:50:02.277947+0000","last_undegraded":"2022-03-15T05:50:02.277947+0000","last_fullsized":"2022-03-15T05:50:02.277947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:07:44.276834+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267837+0000","last_change":"2022-03-15T05:50:01.756439+0000","last_active":"2022-03-15T05:50:02.267837+0000","last_peered":"2022-03-15T05:50:02.267837+0000","last_clean":"2022-03-15T05:50:02.267837+0000","last_became_active":"2022-03-15T05:50:01.756088+0000","last_became_peered":"2022-03-15T05:50:01.756088+0000","last_unstale":"2022-03-15T05:50:02.267837+0000","last_undegraded":"2022-03-15T05:50:02.267837+0000","last_fullsized":"2022-03-15T05:50:02.267837+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:46:26.623500+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275939+0000","last_change":"2022-03-15T05:50:02.271501+0000","last_active":"2022-03-15T05:50:02.275939+0000","last_peered":"2022-03-15T05:50:02.275939+0000","last_clean":"2022-03-15T05:50:02.275939+0000","last_became_active":"2022-03-15T05:50:02.271187+0000","last_became_peered":"2022-03-15T05:50:02.271187+0000","last_unstale":"2022-03-15T05:50:02.275939+0000","last_undegraded":"2022-03-15T05:50:02.275939+0000","last_fullsized":"2022-03-15T05:50:02.275939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:54:59.344451+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279026+0000","last_change":"2022-03-15T05:50:02.274406+0000","last_active":"2022-03-15T05:50:02.279026+0000","last_peered":"2022-03-15T05:50:02.279026+0000","last_clean":"2022-03-15T05:50:02.279026+0000","last_became_active":"2022-03-15T05:50:02.274125+0000","last_became_peered":"2022-03-15T05:50:02.274125+0000","last_unstale":"2022-03-15T05:50:02.279026+0000","last_undegraded":"2022-03-15T05:50:02.279026+0000","last_fullsized":"2022-03-15T05:50:02.279026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:29:08.737054+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277189+0000","last_change":"2022-03-15T05:50:02.272438+0000","last_active":"2022-03-15T05:50:02.277189+0000","last_peered":"2022-03-15T05:50:02.277189+0000","last_clean":"2022-03-15T05:50:02.277189+0000","last_became_active":"2022-03-15T05:50:02.272170+0000","last_became_peered":"2022-03-15T05:50:02.272170+0000","last_unstale":"2022-03-15T05:50:02.277189+0000","last_undegraded":"2022-03-15T05:50:02.277189+0000","last_fullsized":"2022-03-15T05:50:02.277189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:48:35.986901+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.287816+0000","last_change":"2022-03-15T05:50:02.283839+0000","last_active":"2022-03-15T05:50:02.287816+0000","last_peered":"2022-03-15T05:50:02.287816+0000","last_clean":"2022-03-15T05:50:02.287816+0000","last_became_active":"2022-03-15T05:50:02.283609+0000","last_became_peered":"2022-03-15T05:50:02.283609+0000","last_unstale":"2022-03-15T05:50:02.287816+0000","last_undegraded":"2022-03-15T05:50:02.287816+0000","last_fullsized":"2022-03-15T05:50:02.287816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:12:07.158629+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280963+0000","last_change":"2022-03-15T05:50:02.279440+0000","last_active":"2022-03-15T05:50:02.280963+0000","last_peered":"2022-03-15T05:50:02.280963+0000","last_clean":"2022-03-15T05:50:02.280963+0000","last_became_active":"2022-03-15T05:50:02.279161+0000","last_became_peered":"2022-03-15T05:50:02.279161+0000","last_unstale":"2022-03-15T05:50:02.280963+0000","last_undegraded":"2022-03-15T05:50:02.280963+0000","last_fullsized":"2022-03-15T05:50:02.280963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:51:31.533566+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.271955+0000","last_change":"2022-03-15T05:50:02.269218+0000","last_active":"2022-03-15T05:50:02.271955+0000","last_peered":"2022-03-15T05:50:02.271955+0000","last_clean":"2022-03-15T05:50:02.271955+0000","last_became_active":"2022-03-15T05:50:02.268768+0000","last_became_peered":"2022-03-15T05:50:02.268768+0000","last_unstale":"2022-03-15T05:50:02.271955+0000","last_undegraded":"2022-03-15T05:50:02.271955+0000","last_fullsized":"2022-03-15T05:50:02.271955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:17:44.234889+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":1652,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":93616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7940,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363900,"statfs":{"total":96636764160,"available":96628633600,"internally_reserved":0,"allocated":258048,"data_stored":93512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60799999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":778240,"data_stored":620892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64400000000000002}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":91964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]}]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":91964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":91964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8956,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94362884,"statfs":{"total":96636764160,"available":96627593216,"internally_reserved":0,"allocated":774144,"data_stored":619233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":90305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-03-15T05:50:09.545 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2022-03-15T05:50:09.546 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-03-15T05:50:09.546 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2022-03-15T05:50:09.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2022-03-15T05:50:09.547 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2022-03-15T05:50:09.755 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.753+0000 7f1c9a9f7700 1 Processor -- start 2022-03-15T05:50:09.756 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.753+0000 7f1c9a9f7700 1 -- start start 2022-03-15T05:50:09.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.755+0000 7f1c9a9f7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c94067b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.755+0000 7f1c9a9f7700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1c9406eaa0 0x7f1c940c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.755+0000 7f1c9a9f7700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c94068060 con 0x7f1c940c3d70 2022-03-15T05:50:09.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.755+0000 7f1c9a9f7700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c94066d50 con 0x7f1c9406eaa0 2022-03-15T05:50:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.755+0000 7f1c9a9f7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c940678f0 con 0x7f1c9406e6d0 2022-03-15T05:50:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.755+0000 7f1c98f94700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f1c9406eaa0 0x7f1c940c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.755+0000 7f1c93fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c94067b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.755+0000 7f1c937fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f1c940c3d70 0x7f1c940671e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53182/0 (socket says 172.21.15.151:53182) 2022-03-15T05:50:09.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.755+0000 7f1c937fe700 1 -- 172.21.15.151:0/2731351592 learned_addr learned my addr 172.21.15.151:0/2731351592 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:09.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.756+0000 7f1c98f94700 1 -- 172.21.15.151:0/2731351592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 msgr2=0x7f1c94067b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:09.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.756+0000 7f1c98f94700 1 --2- 172.21.15.151:0/2731351592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c94067b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.756+0000 7f1c98f94700 1 -- 172.21.15.151:0/2731351592 >> v1:172.21.15.151:6789/0 conn(0x7f1c940c3d70 legacy=0x7f1c940671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.756+0000 7f1c98f94700 1 -- 172.21.15.151:0/2731351592 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c94066a20 con 0x7f1c9406eaa0 2022-03-15T05:50:09.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.756+0000 7f1c93fff700 1 --2- 172.21.15.151:0/2731351592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c94067b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:09.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.756+0000 7f1c98f94700 1 --2- 172.21.15.151:0/2731351592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9406eaa0 0x7f1c940c05f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009e60 tx=0x7f1c8c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d94152c7ba41b527 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:09.765 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.756+0000 7f1c92ffd700 1 -- 172.21.15.151:0/2731351592 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00e070 con 0x7f1c9406eaa0 2022-03-15T05:50:09.765 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.756+0000 7f1c92ffd700 1 -- 172.21.15.151:0/2731351592 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c00bb60 con 0x7f1c9406eaa0 2022-03-15T05:50:09.765 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.756+0000 7f1c92ffd700 1 -- 172.21.15.151:0/2731351592 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c012430 con 0x7f1c9406eaa0 2022-03-15T05:50:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.757+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/2731351592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9406eaa0 msgr2=0x7f1c940c05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.757+0000 7f1c9a9f7700 1 --2- 172.21.15.151:0/2731351592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9406eaa0 0x7f1c940c05f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c009e60 tx=0x7f1c8c009780 comp rx=0 tx=0).stop 2022-03-15T05:50:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.757+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/2731351592 shutdown_connections 2022-03-15T05:50:09.766 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.757+0000 7f1c9a9f7700 1 --2- 172.21.15.151:0/2731351592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9406eaa0 0x7f1c940c05f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.757+0000 7f1c9a9f7700 1 --2- 172.21.15.151:0/2731351592 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c94067b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.757+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/2731351592 >> 172.21.15.151:0/2731351592 conn(0x7f1c940c75c0 msgr2=0x7f1c940c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:09.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.757+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/2731351592 shutdown_connections 2022-03-15T05:50:09.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.757+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/2731351592 wait complete. 2022-03-15T05:50:09.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.759+0000 7f1c9a9f7700 1 Processor -- start 2022-03-15T05:50:09.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.759+0000 7f1c9a9f7700 1 -- start start 2022-03-15T05:50:09.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c9a9f7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c941651b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c9a9f7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9406eaa0 0x7f1c941523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c9a9f7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c940c3d70 0x7f1c9406d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c9a9f7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c941501a0 con 0x7f1c940c3d70 2022-03-15T05:50:09.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c9a9f7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9414f2b0 con 0x7f1c9406eaa0 2022-03-15T05:50:09.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c9a9f7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9414f590 con 0x7f1c9406e6d0 2022-03-15T05:50:09.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c93fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c941651b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c98f94700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c940c3d70 0x7f1c9406d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c93fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c941651b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60120/0 (socket says 172.21.15.151:60120) 2022-03-15T05:50:09.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c93fff700 1 -- 172.21.15.151:0/4166336065 learned_addr learned my addr 172.21.15.151:0/4166336065 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:09.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.760+0000 7f1c937fe700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9406eaa0 0x7f1c941523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.761+0000 7f1c93fff700 1 -- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9406eaa0 msgr2=0x7f1c941523b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.761+0000 7f1c93fff700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9406eaa0 0x7f1c941523b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.761+0000 7f1c93fff700 1 -- 172.21.15.151:0/4166336065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c940c3d70 msgr2=0x7f1c9406d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:09.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.761+0000 7f1c93fff700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c940c3d70 0x7f1c9406d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:09.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.761+0000 7f1c93fff700 1 -- 172.21.15.151:0/4166336065 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c840092a0 con 0x7f1c9406e6d0 2022-03-15T05:50:09.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.761+0000 7f1c93fff700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c941651b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e980 tx=0x7f1c84009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:09.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.761+0000 7f1c7bfff700 1 -- 172.21.15.151:0/4166336065 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84013680 con 0x7f1c9406e6d0 2022-03-15T05:50:09.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.761+0000 7f1c7bfff700 1 -- 172.21.15.151:0/4166336065 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c840137e0 con 0x7f1c9406e6d0 2022-03-15T05:50:09.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.761+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/4166336065 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c009a20 con 0x7f1c9406e6d0 2022-03-15T05:50:09.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.761+0000 7f1c7bfff700 1 -- 172.21.15.151:0/4166336065 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84013b60 con 0x7f1c9406e6d0 2022-03-15T05:50:09.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.762+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/4166336065 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9414fb50 con 0x7f1c9406e6d0 2022-03-15T05:50:09.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.763+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/4166336065 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c94067ae0 con 0x7f1c9406e6d0 2022-03-15T05:50:09.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.763+0000 7f1c7bfff700 1 -- 172.21.15.151:0/4166336065 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f1c84023070 con 0x7f1c9406e6d0 2022-03-15T05:50:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.764+0000 7f1c7bfff700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1c740633f0 0x7f1c740658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.764+0000 7f1c7bfff700 1 -- 172.21.15.151:0/4166336065 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1c8407ffc0 con 0x7f1c9406e6d0 2022-03-15T05:50:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.764+0000 7f1c937fe700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1c740633f0 0x7f1c740658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:09.775 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.765+0000 7f1c937fe700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1c740633f0 0x7f1c740658a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1c94070db0 tx=0x7f1c88007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:09.776 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:09.769+0000 7f1c7bfff700 1 -- 172.21.15.151:0/4166336065 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f1c8404eff0 con 0x7f1c9406e6d0 2022-03-15T05:50:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.003+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/4166336065 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1c9404b760 con 0x7f1c9406e6d0 2022-03-15T05:50:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.006+0000 7f1c7bfff700 1 -- 172.21.15.151:0/4166336065 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+157590 (secure 0 0 0) 0x7f1c84052610 con 0x7f1c9406e6d0 2022-03-15T05:50:10.011 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:10.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1c740633f0 msgr2=0x7f1c740658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1c740633f0 0x7f1c740658a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f1c94070db0 tx=0x7f1c88007d30 comp rx=0 tx=0).stop 2022-03-15T05:50:10.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 msgr2=0x7f1c941651b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c941651b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f1c8400e980 tx=0x7f1c84009060 comp rx=0 tx=0).stop 2022-03-15T05:50:10.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/4166336065 shutdown_connections 2022-03-15T05:50:10.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1c740633f0 0x7f1c740658a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c940c3d70 0x7f1c9406d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f1c9406e6d0 0x7f1c941651b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 --2- 172.21.15.151:0/4166336065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9406eaa0 0x7f1c941523b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/4166336065 >> 172.21.15.151:0/4166336065 conn(0x7f1c940c75c0 msgr2=0x7f1c940c0050 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/4166336065 shutdown_connections 2022-03-15T05:50:10.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.010+0000 7f1c9a9f7700 1 -- 172.21.15.151:0/4166336065 wait complete. 2022-03-15T05:50:10.036 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":5,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":40466},{"type":"v1","addr":"172.21.15.164:6833","nonce":40466}]},"active_addr":"172.21.15.164:6833/40466","active_change":"2022-03-15T05:49:40.637341+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":4098,"name":"y","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":610559717}]},{"addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2072589101}]},{"addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2056938014}]},{"addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":3081294895}]}]}} 2022-03-15T05:50:10.040 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2022-03-15T05:50:10.040 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2022-03-15T05:50:10.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-15T05:50:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.244+0000 7fe648cb4700 1 Processor -- start 2022-03-15T05:50:10.246 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.244+0000 7fe648cb4700 1 -- start start 2022-03-15T05:50:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.245+0000 7fe648cb4700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fe6440cb1f0 0x7fe6440c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.245+0000 7fe648cb4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6440cb5c0 0x7fe644155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.245+0000 7fe648cb4700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6441566c0 0x7fe6440c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.249 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.245+0000 7fe648cb4700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6440c27b0 con 0x7fe6441566c0 2022-03-15T05:50:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.245+0000 7fe648cb4700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6440c4f90 con 0x7fe6440cb1f0 2022-03-15T05:50:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.245+0000 7fe648cb4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440c5270 con 0x7fe6440cb5c0 2022-03-15T05:50:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe642d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6441566c0 0x7fe6440c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe642d9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6441566c0 0x7fe6440c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60014/0 (socket says 172.21.15.151:60014) 2022-03-15T05:50:10.250 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe642d9d700 1 -- 172.21.15.151:0/489995010 learned_addr learned my addr 172.21.15.151:0/489995010 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:10.251 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe641d9b700 1 --2- 172.21.15.151:0/489995010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6440cb5c0 0x7fe644155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.251 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe64259c700 1 --2- 172.21.15.151:0/489995010 >> v2:172.21.15.164:3300/0 conn(0x7fe6440cb1f0 0x7fe6440c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.251 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe642d9d700 1 -- 172.21.15.151:0/489995010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6440cb5c0 msgr2=0x7fe644155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:10.251 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe642d9d700 1 --2- 172.21.15.151:0/489995010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6440cb5c0 0x7fe644155cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.252 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe642d9d700 1 -- 172.21.15.151:0/489995010 >> v2:172.21.15.164:3300/0 conn(0x7fe6440cb1f0 msgr2=0x7fe6440c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:10.252 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe642d9d700 1 --2- 172.21.15.151:0/489995010 >> v2:172.21.15.164:3300/0 conn(0x7fe6440cb1f0 0x7fe6440c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.252 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe642d9d700 1 -- 172.21.15.151:0/489995010 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6440c2a00 con 0x7fe6441566c0 2022-03-15T05:50:10.252 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.246+0000 7fe642d9d700 1 --2- 172.21.15.151:0/489995010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6441566c0 0x7fe6440c58e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe644088f70 tx=0x7fe63c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbd5347305b1c15 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:10.252 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.247+0000 7fe64159a700 1 -- 172.21.15.151:0/489995010 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c00e070 con 0x7fe6441566c0 2022-03-15T05:50:10.253 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.247+0000 7fe64159a700 1 -- 172.21.15.151:0/489995010 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe63c00b970 con 0x7fe6441566c0 2022-03-15T05:50:10.253 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.247+0000 7fe64159a700 1 -- 172.21.15.151:0/489995010 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe63c0092e0 con 0x7fe6441566c0 2022-03-15T05:50:10.256 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.247+0000 7fe648cb4700 1 -- 172.21.15.151:0/489995010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6441566c0 msgr2=0x7fe6440c58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.257 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.247+0000 7fe648cb4700 1 --2- 172.21.15.151:0/489995010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6441566c0 0x7fe6440c58e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe644088f70 tx=0x7fe63c009840 comp rx=0 tx=0).stop 2022-03-15T05:50:10.257 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.247+0000 7fe648cb4700 1 -- 172.21.15.151:0/489995010 shutdown_connections 2022-03-15T05:50:10.257 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.247+0000 7fe648cb4700 1 --2- 172.21.15.151:0/489995010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6441566c0 0x7fe6440c58e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.258 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.247+0000 7fe648cb4700 1 --2- 172.21.15.151:0/489995010 >> v2:172.21.15.164:3300/0 conn(0x7fe6440cb1f0 0x7fe6440c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.258 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.247+0000 7fe648cb4700 1 --2- 172.21.15.151:0/489995010 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6440cb5c0 0x7fe644155cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.258 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.247+0000 7fe648cb4700 1 -- 172.21.15.151:0/489995010 >> 172.21.15.151:0/489995010 conn(0x7fe644068e90 msgr2=0x7fe644069290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:10.258 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.248+0000 7fe648cb4700 1 -- 172.21.15.151:0/489995010 shutdown_connections 2022-03-15T05:50:10.258 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.248+0000 7fe648cb4700 1 -- 172.21.15.151:0/489995010 wait complete. 2022-03-15T05:50:10.259 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.249+0000 7fe648cb4700 1 Processor -- start 2022-03-15T05:50:10.259 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.249+0000 7fe648cb4700 1 -- start start 2022-03-15T05:50:10.259 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.250+0000 7fe648cb4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6440cb1f0 0x7fe6440c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.259 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.250+0000 7fe648cb4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6440cb5c0 0x7fe644165e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.260 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.250+0000 7fe648cb4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6441566c0 0x7fe6441663b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.260 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.250+0000 7fe648cb4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6440a6c40 con 0x7fe6440cb1f0 2022-03-15T05:50:10.260 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.250+0000 7fe648cb4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6441656a0 con 0x7fe6440cb5c0 2022-03-15T05:50:10.260 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.250+0000 7fe648cb4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe644168cc0 con 0x7fe6441566c0 2022-03-15T05:50:10.260 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe64259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6440cb1f0 0x7fe6440c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.261 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe64259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6440cb1f0 0x7fe6440c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60016/0 (socket says 172.21.15.151:60016) 2022-03-15T05:50:10.261 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe64259c700 1 -- 172.21.15.151:0/1823117652 learned_addr learned my addr 172.21.15.151:0/1823117652 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:10.261 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe641d9b700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6440cb5c0 0x7fe644165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.261 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe642d9d700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6441566c0 0x7fe6441663b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.262 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe64259c700 1 -- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6441566c0 msgr2=0x7fe6441663b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.262 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe64259c700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6441566c0 0x7fe6441663b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.263 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe64259c700 1 -- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6440cb5c0 msgr2=0x7fe644165e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.263 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe64259c700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6440cb5c0 0x7fe644165e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.263 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe64259c700 1 -- 172.21.15.151:0/1823117652 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63c009ae0 con 0x7fe6440cb1f0 2022-03-15T05:50:10.263 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe641d9b700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6440cb5c0 0x7fe644165e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:10.264 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.251+0000 7fe64259c700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6440cb1f0 0x7fe6440c97f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe63400e900 tx=0x7fe634009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:10.264 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.252+0000 7fe6327fc700 1 -- 172.21.15.151:0/1823117652 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634013680 con 0x7fe6440cb1f0 2022-03-15T05:50:10.264 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.252+0000 7fe6327fc700 1 -- 172.21.15.151:0/1823117652 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6340137e0 con 0x7fe6440cb1f0 2022-03-15T05:50:10.264 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.252+0000 7fe6327fc700 1 -- 172.21.15.151:0/1823117652 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe634013b80 con 0x7fe6440cb1f0 2022-03-15T05:50:10.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.252+0000 7fe648cb4700 1 -- 172.21.15.151:0/1823117652 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe644164d70 con 0x7fe6440cb1f0 2022-03-15T05:50:10.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.252+0000 7fe648cb4700 1 -- 172.21.15.151:0/1823117652 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe644165330 con 0x7fe6440cb1f0 2022-03-15T05:50:10.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.253+0000 7fe648cb4700 1 -- 172.21.15.151:0/1823117652 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe644165980 con 0x7fe6440cb1f0 2022-03-15T05:50:10.265 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.254+0000 7fe6327fc700 1 -- 172.21.15.151:0/1823117652 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fe634019030 con 0x7fe6440cb1f0 2022-03-15T05:50:10.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.255+0000 7fe6327fc700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe6200633c0 0x7fe620065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.255+0000 7fe6327fc700 1 -- 172.21.15.151:0/1823117652 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe63407fbe0 con 0x7fe6440cb1f0 2022-03-15T05:50:10.266 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.255+0000 7fe641d9b700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe6200633c0 0x7fe620065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.255+0000 7fe641d9b700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe6200633c0 0x7fe620065870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6440c0d80 tx=0x7fe638009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:10.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.259+0000 7fe6327fc700 1 -- 172.21.15.151:0/1823117652 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fe63404eb80 con 0x7fe6440cb1f0 2022-03-15T05:50:10.453 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.451+0000 7fe648cb4700 1 -- 172.21.15.151:0/1823117652 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6440700c0 con 0x7fe6440cb1f0 2022-03-15T05:50:10.454 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.452+0000 7fe6327fc700 1 -- 172.21.15.151:0/1823117652 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16893 (secure 0 0 0) 0x7fe6340521a0 con 0x7fe6440cb1f0 2022-03-15T05:50:10.454 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:10.455 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":24,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:50:03.251425+0000","last_up_change":"2022-03-15T05:49:47.305366+0000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-03-15T05:49:46.741897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-03-15T05:49:54.617407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-15T05:49:59.845834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-15T05:50:01.249141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":35552},{"type":"v1","addr":"172.21.15.151:6801","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":35552},{"type":"v1","addr":"172.21.15.151:6803","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":35552},{"type":"v1","addr":"172.21.15.151:6807","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":35552},{"type":"v1","addr":"172.21.15.151:6805","nonce":35552}]},"public_addr":"172.21.15.151:6801/35552","cluster_addr":"172.21.15.151:6803/35552","heartbeat_back_addr":"172.21.15.151:6807/35552","heartbeat_front_addr":"172.21.15.151:6805/35552","state":["exists","up"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":35554},{"type":"v1","addr":"172.21.15.151:6821","nonce":35554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":35554},{"type":"v1","addr":"172.21.15.151:6825","nonce":35554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":35554},{"type":"v1","addr":"172.21.15.151:6831","nonce":35554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":35554},{"type":"v1","addr":"172.21.15.151:6829","nonce":35554}]},"public_addr":"172.21.15.151:6821/35554","cluster_addr":"172.21.15.151:6825/35554","heartbeat_back_addr":"172.21.15.151:6831/35554","heartbeat_front_addr":"172.21.15.151:6829/35554","state":["exists","up"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":35555},{"type":"v1","addr":"172.21.15.151:6817","nonce":35555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":35555},{"type":"v1","addr":"172.21.15.151:6820","nonce":35555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":35555},{"type":"v1","addr":"172.21.15.151:6828","nonce":35555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":35555},{"type":"v1","addr":"172.21.15.151:6824","nonce":35555}]},"public_addr":"172.21.15.151:6817/35555","cluster_addr":"172.21.15.151:6820/35555","heartbeat_back_addr":"172.21.15.151:6828/35555","heartbeat_front_addr":"172.21.15.151:6824/35555","state":["exists","up"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":35553},{"type":"v1","addr":"172.21.15.151:6809","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":35553},{"type":"v1","addr":"172.21.15.151:6811","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":35553},{"type":"v1","addr":"172.21.15.151:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":35553},{"type":"v1","addr":"172.21.15.151:6813","nonce":35553}]},"public_addr":"172.21.15.151:6809/35553","cluster_addr":"172.21.15.151:6811/35553","heartbeat_back_addr":"172.21.15.151:6815/35553","heartbeat_front_addr":"172.21.15.151:6813/35553","state":["exists","up"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":41130},{"type":"v1","addr":"172.21.15.164:6825","nonce":41130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":41130},{"type":"v1","addr":"172.21.15.164:6827","nonce":41130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":41130},{"type":"v1","addr":"172.21.15.164:6831","nonce":41130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":41130},{"type":"v1","addr":"172.21.15.164:6829","nonce":41130}]},"public_addr":"172.21.15.164:6825/41130","cluster_addr":"172.21.15.164:6827/41130","heartbeat_back_addr":"172.21.15.164:6831/41130","heartbeat_front_addr":"172.21.15.164:6829/41130","state":["exists","up"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":41119},{"type":"v1","addr":"172.21.15.164:6801","nonce":41119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":41119},{"type":"v1","addr":"172.21.15.164:6803","nonce":41119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":41119},{"type":"v1","addr":"172.21.15.164:6807","nonce":41119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":41119},{"type":"v1","addr":"172.21.15.164:6805","nonce":41119}]},"public_addr":"172.21.15.164:6801/41119","cluster_addr":"172.21.15.164:6803/41119","heartbeat_back_addr":"172.21.15.164:6807/41119","heartbeat_front_addr":"172.21.15.164:6805/41119","state":["exists","up"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":41129},{"type":"v1","addr":"172.21.15.164:6817","nonce":41129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":41129},{"type":"v1","addr":"172.21.15.164:6819","nonce":41129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":41129},{"type":"v1","addr":"172.21.15.164:6823","nonce":41129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":41129},{"type":"v1","addr":"172.21.15.164:6821","nonce":41129}]},"public_addr":"172.21.15.164:6817/41129","cluster_addr":"172.21.15.164:6819/41129","heartbeat_back_addr":"172.21.15.164:6823/41129","heartbeat_front_addr":"172.21.15.164:6821/41129","state":["exists","up"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":41120},{"type":"v1","addr":"172.21.15.164:6809","nonce":41120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":41120},{"type":"v1","addr":"172.21.15.164:6811","nonce":41120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":41120},{"type":"v1","addr":"172.21.15.164:6816","nonce":41120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":41120},{"type":"v1","addr":"172.21.15.164:6813","nonce":41120}]},"public_addr":"172.21.15.164:6809/41120","cluster_addr":"172.21.15.164:6811/41120","heartbeat_back_addr":"172.21.15.164:6816/41120","heartbeat_front_addr":"172.21.15.164:6813/41120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.378836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.466901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.764352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.688587+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.304917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.236409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.231122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.208581+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:50:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.454+0000 7fe648cb4700 1 -- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe6200633c0 msgr2=0x7fe620065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.457 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe6200633c0 0x7fe620065870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe6440c0d80 tx=0x7fe638009060 comp rx=0 tx=0).stop 2022-03-15T05:50:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 -- 172.21.15.151:0/1823117652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6440cb1f0 msgr2=0x7fe6440c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6440cb1f0 0x7fe6440c97f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe63400e900 tx=0x7fe634009060 comp rx=0 tx=0).stop 2022-03-15T05:50:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 -- 172.21.15.151:0/1823117652 shutdown_connections 2022-03-15T05:50:10.458 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe6200633c0 0x7fe620065870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe6441566c0 0x7fe6441663b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6440cb1f0 0x7fe6440c97f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 --2- 172.21.15.151:0/1823117652 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe6440cb5c0 0x7fe644165e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.459 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 -- 172.21.15.151:0/1823117652 >> 172.21.15.151:0/1823117652 conn(0x7fe644068e90 msgr2=0x7fe644152310 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:10.460 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 -- 172.21.15.151:0/1823117652 shutdown_connections 2022-03-15T05:50:10.460 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.455+0000 7fe648cb4700 1 -- 172.21.15.151:0/1823117652 wait complete. 2022-03-15T05:50:10.482 INFO:tasks.ceph.ceph_manager.ceph:all up! 2022-03-15T05:50:10.482 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-15T05:50:10.690 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.688+0000 7f7809cfb700 1 Processor -- start 2022-03-15T05:50:10.691 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.688+0000 7f7809cfb700 1 -- start start 2022-03-15T05:50:10.694 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.689+0000 7f7809cfb700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7804155340 0x7f78040c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.694 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.689+0000 7f7809cfb700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7804158560 con 0x7f78040c56e0 2022-03-15T05:50:10.694 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.689+0000 7f7809cfb700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7804158840 con 0x7f78040c2b30 2022-03-15T05:50:10.695 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.689+0000 7f7809cfb700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7804158b20 con 0x7f7804155340 2022-03-15T05:50:10.695 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f7803fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f78040c56e0 0x7f78040c4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53184/0 (socket says 172.21.15.151:53184) 2022-03-15T05:50:10.695 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f78094fa700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7804155340 0x7f78040c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.695 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f7803fff700 1 -- 172.21.15.151:0/2677135008 learned_addr learned my addr 172.21.15.151:0/2677135008 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:10.696 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f7808cf9700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f78040c2b30 0x7f7804157d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33650/0 (socket says 172.21.15.151:33650) 2022-03-15T05:50:10.696 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f78037fe700 1 -- 172.21.15.151:0/2677135008 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3381828916 0 0) 0x7f7804158840 con 0x7f78040c2b30 2022-03-15T05:50:10.696 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f78037fe700 1 -- 172.21.15.151:0/2677135008 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77e80033f0 con 0x7f78040c2b30 2022-03-15T05:50:10.696 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f78094fa700 1 -- 172.21.15.151:0/2677135008 >> v1:172.21.15.164:6789/0 conn(0x7f78040c2b30 legacy=0x7f7804157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.697 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f78094fa700 1 -- 172.21.15.151:0/2677135008 >> v1:172.21.15.151:6789/0 conn(0x7f78040c56e0 legacy=0x7f78040c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.697 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f78037fe700 1 -- 172.21.15.151:0/2677135008 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4256402042 0 0) 0x7f7804158560 con 0x7f78040c56e0 2022-03-15T05:50:10.697 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f78094fa700 1 -- 172.21.15.151:0/2677135008 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7804154860 con 0x7f7804155340 2022-03-15T05:50:10.697 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.690+0000 7f78094fa700 1 --2- 172.21.15.151:0/2677135008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7804155340 0x7f78040c2050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009e60 tx=0x7f77fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83b87659780cd98 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:10.698 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.691+0000 7f78037fe700 1 -- 172.21.15.151:0/2677135008 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc00e070 con 0x7f7804155340 2022-03-15T05:50:10.698 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.691+0000 7f78037fe700 1 -- 172.21.15.151:0/2677135008 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77fc00bb60 con 0x7f7804155340 2022-03-15T05:50:10.698 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.691+0000 7f78037fe700 1 -- 172.21.15.151:0/2677135008 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77fc012430 con 0x7f7804155340 2022-03-15T05:50:10.698 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.691+0000 7f7809cfb700 1 -- 172.21.15.151:0/2677135008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7804155340 msgr2=0x7f78040c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.699 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.691+0000 7f7809cfb700 1 --2- 172.21.15.151:0/2677135008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7804155340 0x7f78040c2050 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77fc009e60 tx=0x7f77fc009780 comp rx=0 tx=0).stop 2022-03-15T05:50:10.699 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.691+0000 7f7809cfb700 1 -- 172.21.15.151:0/2677135008 shutdown_connections 2022-03-15T05:50:10.699 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.691+0000 7f7809cfb700 1 --2- 172.21.15.151:0/2677135008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7804155340 0x7f78040c2050 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.699 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.691+0000 7f7809cfb700 1 -- 172.21.15.151:0/2677135008 >> 172.21.15.151:0/2677135008 conn(0x7f78040cae10 msgr2=0x7f78040cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:10.700 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.691+0000 7f7809cfb700 1 -- 172.21.15.151:0/2677135008 shutdown_connections 2022-03-15T05:50:10.700 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.692+0000 7f7809cfb700 1 -- 172.21.15.151:0/2677135008 wait complete. 2022-03-15T05:50:10.704 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.693+0000 7f7809cfb700 1 Processor -- start 2022-03-15T05:50:10.704 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.693+0000 7f7809cfb700 1 -- start start 2022-03-15T05:50:10.705 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f7809cfb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78040c2b30 0x7f7804164fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.705 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f7809cfb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78040c56e0 0x7f78040a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.705 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f7809cfb700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7804155340 0x7f78040c4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.705 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f7809cfb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78040a77e0 con 0x7f78040c2b30 2022-03-15T05:50:10.706 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f7809cfb700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78041654f0 con 0x7f78040c56e0 2022-03-15T05:50:10.706 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f7809cfb700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78040a7c50 con 0x7f7804155340 2022-03-15T05:50:10.706 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f7808cf9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78040c2b30 0x7f7804164fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.706 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f7808cf9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78040c2b30 0x7f7804164fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60020/0 (socket says 172.21.15.151:60020) 2022-03-15T05:50:10.706 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f7808cf9700 1 -- 172.21.15.151:0/2174599701 learned_addr learned my addr 172.21.15.151:0/2174599701 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:10.707 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f7803fff700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78040c56e0 0x7f78040a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.707 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.694+0000 7f78094fa700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7804155340 0x7f78040c4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.707 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.695+0000 7f7808cf9700 1 -- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7804155340 msgr2=0x7f78040c4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.707 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.695+0000 7f7808cf9700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7804155340 0x7f78040c4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.708 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.695+0000 7f7808cf9700 1 -- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78040c56e0 msgr2=0x7f78040a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.708 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.695+0000 7f7808cf9700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78040c56e0 0x7f78040a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.708 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.695+0000 7f7808cf9700 1 -- 172.21.15.151:0/2174599701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77fc009a20 con 0x7f78040c2b30 2022-03-15T05:50:10.708 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.695+0000 7f7808cf9700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78040c2b30 0x7f7804164fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c440 tx=0x7f77f8007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:10.709 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.695+0000 7f7800ff9700 1 -- 172.21.15.151:0/2174599701 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f80070d0 con 0x7f78040c2b30 2022-03-15T05:50:10.709 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.695+0000 7f7800ff9700 1 -- 172.21.15.151:0/2174599701 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f8007230 con 0x7f78040c2b30 2022-03-15T05:50:10.709 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.695+0000 7f7800ff9700 1 -- 172.21.15.151:0/2174599701 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f80046b0 con 0x7f78040c2b30 2022-03-15T05:50:10.709 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.695+0000 7f7809cfb700 1 -- 172.21.15.151:0/2174599701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7804151330 con 0x7f78040c2b30 2022-03-15T05:50:10.709 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.696+0000 7f7809cfb700 1 -- 172.21.15.151:0/2174599701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78041518f0 con 0x7f78040c2b30 2022-03-15T05:50:10.710 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.697+0000 7f7809cfb700 1 -- 172.21.15.151:0/2174599701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78040637b0 con 0x7f78040c2b30 2022-03-15T05:50:10.710 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.697+0000 7f7800ff9700 1 -- 172.21.15.151:0/2174599701 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f77f8010070 con 0x7f78040c2b30 2022-03-15T05:50:10.710 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.698+0000 7f7800ff9700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77ec0633c0 0x7f77ec065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:10.710 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.699+0000 7f7800ff9700 1 -- 172.21.15.151:0/2174599701 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f77f807ee10 con 0x7f78040c2b30 2022-03-15T05:50:10.711 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.699+0000 7f7803fff700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77ec0633c0 0x7f77ec065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:10.711 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.699+0000 7f7803fff700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77ec0633c0 0x7f77ec065870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7804158320 tx=0x7f77f0007bb0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:10.711 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.703+0000 7f7800ff9700 1 -- 172.21.15.151:0/2174599701 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f77f8048ac0 con 0x7f78040c2b30 2022-03-15T05:50:10.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.891+0000 7f7809cfb700 1 -- 172.21.15.151:0/2174599701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78040c51d0 con 0x7f78040c2b30 2022-03-15T05:50:10.894 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.892+0000 7f7800ff9700 1 -- 172.21.15.151:0/2174599701 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16893 (secure 0 0 0) 0x7f77f8082030 con 0x7f78040c2b30 2022-03-15T05:50:10.895 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:10.895 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":24,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:50:03.251425+0000","last_up_change":"2022-03-15T05:49:47.305366+0000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-03-15T05:49:46.741897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-03-15T05:49:54.617407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-15T05:49:59.845834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-15T05:50:01.249141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":35552},{"type":"v1","addr":"172.21.15.151:6801","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":35552},{"type":"v1","addr":"172.21.15.151:6803","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":35552},{"type":"v1","addr":"172.21.15.151:6807","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":35552},{"type":"v1","addr":"172.21.15.151:6805","nonce":35552}]},"public_addr":"172.21.15.151:6801/35552","cluster_addr":"172.21.15.151:6803/35552","heartbeat_back_addr":"172.21.15.151:6807/35552","heartbeat_front_addr":"172.21.15.151:6805/35552","state":["exists","up"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":35554},{"type":"v1","addr":"172.21.15.151:6821","nonce":35554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":35554},{"type":"v1","addr":"172.21.15.151:6825","nonce":35554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":35554},{"type":"v1","addr":"172.21.15.151:6831","nonce":35554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":35554},{"type":"v1","addr":"172.21.15.151:6829","nonce":35554}]},"public_addr":"172.21.15.151:6821/35554","cluster_addr":"172.21.15.151:6825/35554","heartbeat_back_addr":"172.21.15.151:6831/35554","heartbeat_front_addr":"172.21.15.151:6829/35554","state":["exists","up"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":35555},{"type":"v1","addr":"172.21.15.151:6817","nonce":35555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":35555},{"type":"v1","addr":"172.21.15.151:6820","nonce":35555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":35555},{"type":"v1","addr":"172.21.15.151:6828","nonce":35555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":35555},{"type":"v1","addr":"172.21.15.151:6824","nonce":35555}]},"public_addr":"172.21.15.151:6817/35555","cluster_addr":"172.21.15.151:6820/35555","heartbeat_back_addr":"172.21.15.151:6828/35555","heartbeat_front_addr":"172.21.15.151:6824/35555","state":["exists","up"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":35553},{"type":"v1","addr":"172.21.15.151:6809","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":35553},{"type":"v1","addr":"172.21.15.151:6811","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":35553},{"type":"v1","addr":"172.21.15.151:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":35553},{"type":"v1","addr":"172.21.15.151:6813","nonce":35553}]},"public_addr":"172.21.15.151:6809/35553","cluster_addr":"172.21.15.151:6811/35553","heartbeat_back_addr":"172.21.15.151:6815/35553","heartbeat_front_addr":"172.21.15.151:6813/35553","state":["exists","up"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":41130},{"type":"v1","addr":"172.21.15.164:6825","nonce":41130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":41130},{"type":"v1","addr":"172.21.15.164:6827","nonce":41130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":41130},{"type":"v1","addr":"172.21.15.164:6831","nonce":41130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":41130},{"type":"v1","addr":"172.21.15.164:6829","nonce":41130}]},"public_addr":"172.21.15.164:6825/41130","cluster_addr":"172.21.15.164:6827/41130","heartbeat_back_addr":"172.21.15.164:6831/41130","heartbeat_front_addr":"172.21.15.164:6829/41130","state":["exists","up"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":41119},{"type":"v1","addr":"172.21.15.164:6801","nonce":41119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":41119},{"type":"v1","addr":"172.21.15.164:6803","nonce":41119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":41119},{"type":"v1","addr":"172.21.15.164:6807","nonce":41119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":41119},{"type":"v1","addr":"172.21.15.164:6805","nonce":41119}]},"public_addr":"172.21.15.164:6801/41119","cluster_addr":"172.21.15.164:6803/41119","heartbeat_back_addr":"172.21.15.164:6807/41119","heartbeat_front_addr":"172.21.15.164:6805/41119","state":["exists","up"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":41129},{"type":"v1","addr":"172.21.15.164:6817","nonce":41129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":41129},{"type":"v1","addr":"172.21.15.164:6819","nonce":41129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":41129},{"type":"v1","addr":"172.21.15.164:6823","nonce":41129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":41129},{"type":"v1","addr":"172.21.15.164:6821","nonce":41129}]},"public_addr":"172.21.15.164:6817/41129","cluster_addr":"172.21.15.164:6819/41129","heartbeat_back_addr":"172.21.15.164:6823/41129","heartbeat_front_addr":"172.21.15.164:6821/41129","state":["exists","up"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":41120},{"type":"v1","addr":"172.21.15.164:6809","nonce":41120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":41120},{"type":"v1","addr":"172.21.15.164:6811","nonce":41120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":41120},{"type":"v1","addr":"172.21.15.164:6816","nonce":41120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":41120},{"type":"v1","addr":"172.21.15.164:6813","nonce":41120}]},"public_addr":"172.21.15.164:6809/41120","cluster_addr":"172.21.15.164:6811/41120","heartbeat_back_addr":"172.21.15.164:6816/41120","heartbeat_front_addr":"172.21.15.164:6813/41120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.378836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.466901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.764352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.688587+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.304917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.236409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.231122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.208581+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:50:10.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 -- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77ec0633c0 msgr2=0x7f77ec065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77ec0633c0 0x7f77ec065870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7804158320 tx=0x7f77f0007bb0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 -- 172.21.15.151:0/2174599701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78040c2b30 msgr2=0x7f7804164fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:10.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78040c2b30 0x7f7804164fb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77f800c440 tx=0x7f77f8007c70 comp rx=0 tx=0).stop 2022-03-15T05:50:10.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 -- 172.21.15.151:0/2174599701 shutdown_connections 2022-03-15T05:50:10.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f77ec0633c0 0x7f77ec065870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7804155340 0x7f78040c4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78040c2b30 0x7f7804164fb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 --2- 172.21.15.151:0/2174599701 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f78040c56e0 0x7f78040a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:10.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 -- 172.21.15.151:0/2174599701 >> 172.21.15.151:0/2174599701 conn(0x7f78040cae10 msgr2=0x7f780414e510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:10.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 -- 172.21.15.151:0/2174599701 shutdown_connections 2022-03-15T05:50:10.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:10.894+0000 7f7809cfb700 1 -- 172.21.15.151:0/2174599701 wait complete. 2022-03-15T05:50:10.921 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2022-03-15T05:50:10.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2022-03-15T05:50:10.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2022-03-15T05:50:10.923 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2022-03-15T05:50:10.923 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2022-03-15T05:50:10.924 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2022-03-15T05:50:10.925 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2022-03-15T05:50:10.925 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2022-03-15T05:50:11.299 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.295+0000 7f2ef712e700 1 Processor -- start 2022-03-15T05:50:11.299 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.296+0000 7f2ef712e700 1 -- start start 2022-03-15T05:50:11.303 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.298+0000 7f2ef712e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2ef00c5ff0 0x7f2ef0158ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.303 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.298+0000 7f2ef712e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef00c9270 con 0x7f2ef006c980 2022-03-15T05:50:11.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.299+0000 7f2ef712e700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ef00bc680 con 0x7f2ef0159400 2022-03-15T05:50:11.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.299+0000 7f2ef712e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ef00c8cf0 con 0x7f2ef00c5ff0 2022-03-15T05:50:11.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.299+0000 7f2ef4eca700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2ef00c5ff0 0x7f2ef0158ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.300+0000 7f2ef4eca700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f2ef00c5ff0 0x7f2ef0158ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57240/0 (socket says 172.21.15.151:57240) 2022-03-15T05:50:11.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.300+0000 7f2ef4eca700 1 -- 172.21.15.151:0/2999348799 learned_addr learned my addr 172.21.15.151:0/2999348799 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.301+0000 7f2ef4eca700 1 -- 172.21.15.151:0/2999348799 >> v1:172.21.15.164:6789/0 conn(0x7f2ef0159400 legacy=0x7f2ef00c3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.301+0000 7f2ef4eca700 1 -- 172.21.15.151:0/2999348799 >> v1:172.21.15.151:6789/0 conn(0x7f2ef006c980 legacy=0x7f2ef0163750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.301+0000 7f2ef4eca700 1 -- 172.21.15.151:0/2999348799 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ef006c0d0 con 0x7f2ef00c5ff0 2022-03-15T05:50:11.306 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.301+0000 7f2ef4eca700 1 --2- 172.21.15.151:0/2999348799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef00c5ff0 0x7f2ef0158ec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009f20 tx=0x7f2ee8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cae1677efd21484e server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.301+0000 7f2eef7fe700 1 -- 172.21.15.151:0/2999348799 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee800e070 con 0x7f2ef00c5ff0 2022-03-15T05:50:11.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.302+0000 7f2eef7fe700 1 -- 172.21.15.151:0/2999348799 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee800ba40 con 0x7f2ef00c5ff0 2022-03-15T05:50:11.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.302+0000 7f2eef7fe700 1 -- 172.21.15.151:0/2999348799 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee80092e0 con 0x7f2ef00c5ff0 2022-03-15T05:50:11.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.303+0000 7f2ef712e700 1 -- 172.21.15.151:0/2999348799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef00c5ff0 msgr2=0x7f2ef0158ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.303+0000 7f2ef712e700 1 --2- 172.21.15.151:0/2999348799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef00c5ff0 0x7f2ef0158ec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009f20 tx=0x7f2ee8009840 comp rx=0 tx=0).stop 2022-03-15T05:50:11.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.303+0000 7f2ef712e700 1 -- 172.21.15.151:0/2999348799 shutdown_connections 2022-03-15T05:50:11.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.303+0000 7f2ef712e700 1 --2- 172.21.15.151:0/2999348799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef00c5ff0 0x7f2ef0158ec0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.303+0000 7f2ef712e700 1 -- 172.21.15.151:0/2999348799 >> 172.21.15.151:0/2999348799 conn(0x7f2ef006e5c0 msgr2=0x7f2ef006e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.303+0000 7f2ef712e700 1 -- 172.21.15.151:0/2999348799 shutdown_connections 2022-03-15T05:50:11.309 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.304+0000 7fe46dfac700 1 Processor -- start 2022-03-15T05:50:11.309 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.303+0000 7f2ef712e700 1 -- 172.21.15.151:0/2999348799 wait complete. 2022-03-15T05:50:11.311 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.305+0000 7fe46dfac700 1 -- start start 2022-03-15T05:50:11.312 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.307+0000 7fe46dfac700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe4680c4090 0x7fe4680c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.312 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.307+0000 7fe46dfac700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe46806ced0 con 0x7fe468066b40 2022-03-15T05:50:11.312 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.307+0000 7fe46dfac700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe468159740 con 0x7fe468067c20 2022-03-15T05:50:11.312 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.307+0000 7fe46dfac700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46806e510 con 0x7fe4680c4090 2022-03-15T05:50:11.313 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.308+0000 7fe4677fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fe468066b40 0x7fe468066f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53190/0 (socket says 172.21.15.151:53190) 2022-03-15T05:50:11.313 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.308+0000 7fe4677fe700 1 -- 172.21.15.151:0/1611668755 learned_addr learned my addr 172.21.15.151:0/1611668755 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:11.313 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.309+0000 7fe466ffd700 1 --2- 172.21.15.151:0/1611668755 >> v2:172.21.15.151:3300/0 conn(0x7fe4680c4090 0x7fe4680c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.313 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.309+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473983016 0 0) 0x7fe46806ced0 con 0x7fe468066b40 2022-03-15T05:50:11.314 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.309+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4540033f0 con 0x7fe468066b40 2022-03-15T05:50:11.314 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.306+0000 7f2ef712e700 1 Processor -- start 2022-03-15T05:50:11.315 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.306+0000 7f2ef712e700 1 -- start start 2022-03-15T05:50:11.315 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.308+0000 7f2ef712e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef006c980 0x7f2ef0157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.315 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.308+0000 7f2ef712e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ef00c5ff0 0x7f2ef015a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.315 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.308+0000 7f2ef712e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef0159400 0x7f2ef0174d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.316 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.308+0000 7f2ef712e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef00bdfc0 con 0x7f2ef00c5ff0 2022-03-15T05:50:11.316 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.308+0000 7f2ef712e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef015d210 con 0x7f2ef0159400 2022-03-15T05:50:11.316 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.308+0000 7f2ef712e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ef015cd80 con 0x7f2ef006c980 2022-03-15T05:50:11.316 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.309+0000 7f2ef56cb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef0159400 0x7f2ef0174d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.317 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.309+0000 7f2ef56cb700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef0159400 0x7f2ef0174d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57242/0 (socket says 172.21.15.151:57242) 2022-03-15T05:50:11.317 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.309+0000 7f2ef56cb700 1 -- 172.21.15.151:0/2812347001 learned_addr learned my addr 172.21.15.151:0/2812347001 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.317 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.309+0000 7f2ef4eca700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef006c980 0x7f2ef0157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.317 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 <== mon.0 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4277833304 0 0) 0x7fe4540033f0 con 0x7fe468066b40 2022-03-15T05:50:11.318 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 >> v2:172.21.15.151:3300/0 conn(0x7fe4680c4090 msgr2=0x7fe4680c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.318 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 --2- 172.21.15.151:0/1611668755 >> v2:172.21.15.151:3300/0 conn(0x7fe4680c4090 0x7fe4680c14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.318 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 >> v1:172.21.15.164:6789/0 conn(0x7fe468067c20 legacy=0x7fe468155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.318 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4681599d0 con 0x7fe468066b40 2022-03-15T05:50:11.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 <== mon.0 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1345219590 0 0) 0x7fe4580017f0 con 0x7fe468066b40 2022-03-15T05:50:11.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 >> v1:172.21.15.151:6789/0 conn(0x7fe468066b40 legacy=0x7fe468066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 --2- 172.21.15.151:0/1611668755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 0x7fe454003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 --2- 172.21.15.151:0/1611668755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe454004690 0x7fe454004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 --2- 172.21.15.151:0/1611668755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe454005160 0x7fe45400b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46806e510 con 0x7fe454004690 2022-03-15T05:50:11.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45400c120 con 0x7fe4540038e0 2022-03-15T05:50:11.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45400c2e0 con 0x7fe454005160 2022-03-15T05:50:11.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.312+0000 7fe4677fe700 1 --2- 172.21.15.151:0/1611668755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 0x7fe454003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.310+0000 7f2ef56cb700 1 -- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef006c980 msgr2=0x7f2ef0157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.310+0000 7f2ef56cb700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f2ef006c980 0x7f2ef0157250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.310+0000 7f2ef56cb700 1 -- 172.21.15.151:0/2812347001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ef00c5ff0 msgr2=0x7f2ef015a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.310+0000 7f2ef56cb700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ef00c5ff0 0x7f2ef015a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.310+0000 7f2ef56cb700 1 -- 172.21.15.151:0/2812347001 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ee8009ae0 con 0x7f2ef0159400 2022-03-15T05:50:11.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.310+0000 7f2ef56cb700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef0159400 0x7f2ef0174d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000c470 tx=0x7f2ee0007d70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7f2eecff9700 1 -- 172.21.15.151:0/2812347001 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee000ce90 con 0x7f2ef0159400 2022-03-15T05:50:11.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7f2eecff9700 1 -- 172.21.15.151:0/2812347001 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ee00050d0 con 0x7f2ef0159400 2022-03-15T05:50:11.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7f2eecff9700 1 -- 172.21.15.151:0/2812347001 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ee0011590 con 0x7f2ef0159400 2022-03-15T05:50:11.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.313+0000 7fe4677fe700 1 -- 172.21.15.151:0/1611668755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe454005160 msgr2=0x7fe45400b8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-03-15T05:50:11.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.313+0000 7fe4677fe700 1 --2- 172.21.15.151:0/1611668755 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe454005160 0x7fe45400b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.313+0000 7fe4677fe700 1 -- 172.21.15.151:0/1611668755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe454004690 msgr2=0x7fe454004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.313+0000 7fe4677fe700 1 --2- 172.21.15.151:0/1611668755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe454004690 0x7fe454004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.313+0000 7fe4677fe700 1 -- 172.21.15.151:0/1611668755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4681599d0 con 0x7fe4540038e0 2022-03-15T05:50:11.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.314+0000 7fe467fff700 1 -- 172.21.15.151:0/1611668755 reap_dead start 2022-03-15T05:50:11.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ef00bfa70 con 0x7f2ef0159400 2022-03-15T05:50:11.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.311+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ef00bf790 con 0x7f2ef0159400 2022-03-15T05:50:11.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.312+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ef015c5b0 con 0x7f2ef0159400 2022-03-15T05:50:11.326 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.314+0000 7fe4677fe700 1 --2- 172.21.15.151:0/1611668755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 0x7fe454003cf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c640 tx=0x7fe458001d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9db345b5d280b5ea server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.315+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458001f70 con 0x7fe4540038e0 2022-03-15T05:50:11.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.315+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45800ce40 con 0x7fe4540038e0 2022-03-15T05:50:11.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.315+0000 7fe4667fc700 1 -- 172.21.15.151:0/1611668755 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458005d50 con 0x7fe4540038e0 2022-03-15T05:50:11.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.316+0000 7fe46dfac700 1 -- 172.21.15.151:0/1611668755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 msgr2=0x7fe454003cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.316+0000 7fe46dfac700 1 --2- 172.21.15.151:0/1611668755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 0x7fe454003cf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c640 tx=0x7fe458001d20 comp rx=0 tx=0).stop 2022-03-15T05:50:11.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.316+0000 7fe46dfac700 1 -- 172.21.15.151:0/1611668755 shutdown_connections 2022-03-15T05:50:11.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.316+0000 7fe46dfac700 1 --2- 172.21.15.151:0/1611668755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 0x7fe454003cf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.316+0000 7fe46dfac700 1 -- 172.21.15.151:0/1611668755 >> 172.21.15.151:0/1611668755 conn(0x7fe4680c75c0 msgr2=0x7fe4680c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.316+0000 7f2eecff9700 1 -- 172.21.15.151:0/2812347001 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f2ee0019030 con 0x7f2ef0159400 2022-03-15T05:50:11.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.314+0000 7fcadc145700 1 Processor -- start 2022-03-15T05:50:11.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.314+0000 7fcadc145700 1 -- start start 2022-03-15T05:50:11.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.317+0000 7fcadc145700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcad4066b40 0x7fcad40bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.317+0000 7fcadc145700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad40c25b0 con 0x7fcad40c2a40 2022-03-15T05:50:11.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.317+0000 7fcadc145700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcad40c4210 con 0x7fcad406edc0 2022-03-15T05:50:11.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.317+0000 7fcadc145700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcad4067fd0 con 0x7fcad4066b40 2022-03-15T05:50:11.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.317+0000 7fcad9ee1700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcad4066b40 0x7fcad40bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.318+0000 7fcad9ee1700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fcad4066b40 0x7fcad40bdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57246/0 (socket says 172.21.15.151:57246) 2022-03-15T05:50:11.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.318+0000 7fcad9ee1700 1 -- 172.21.15.151:0/2259280713 learned_addr learned my addr 172.21.15.151:0/2259280713 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.317+0000 7f9bc77fe700 1 Processor -- start 2022-03-15T05:50:11.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.317+0000 7f9bc77fe700 1 -- start start 2022-03-15T05:50:11.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.318+0000 7fe46dfac700 1 -- 172.21.15.151:0/1611668755 shutdown_connections 2022-03-15T05:50:11.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.318+0000 7f2eecff9700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2ed0063510 0x7f2ed00659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.318+0000 7f2eecff9700 1 -- 172.21.15.151:0/2812347001 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ee007f4d0 con 0x7f2ef0159400 2022-03-15T05:50:11.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.318+0000 7f2eecff9700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.151:6819/35554,v1:172.21.15.151:6821/35554] conn(0x7f2ed006bd70 0x7f2ed006e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.318+0000 7f2eecff9700 1 -- 172.21.15.151:0/2812347001 --> [v2:172.21.15.151:6819/35554,v1:172.21.15.151:6821/35554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ed006e830 con 0x7f2ed006bd70 2022-03-15T05:50:11.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.318+0000 7f2eecff9700 1 -- 172.21.15.151:0/2812347001 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ee007f800 con 0x7f2ef0159400 2022-03-15T05:50:11.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.319+0000 7f2ef4eca700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2ed0063510 0x7f2ed00659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.335 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.319+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757059518 0 0) 0x7fcad40c4210 con 0x7fcad406edc0 2022-03-15T05:50:11.335 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.319+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab80033f0 con 0x7fcad406edc0 2022-03-15T05:50:11.336 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.319+0000 7f2eeffff700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.151:6819/35554,v1:172.21.15.151:6821/35554] conn(0x7f2ed006bd70 0x7f2ed006e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.336 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954742843 0 0) 0x7fcad40c25b0 con 0x7fcad40c2a40 2022-03-15T05:50:11.336 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad40c4210 con 0x7fcad40c2a40 2022-03-15T05:50:11.337 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2752799238 0 0) 0x7fcab80033f0 con 0x7fcad406edc0 2022-03-15T05:50:11.337 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 >> v2:172.21.15.164:3300/0 conn(0x7fcad4066b40 msgr2=0x7fcad40bdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.337 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 --2- 172.21.15.151:0/2259280713 >> v2:172.21.15.164:3300/0 conn(0x7fcad4066b40 0x7fcad40bdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.337 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 >> v1:172.21.15.151:6789/0 conn(0x7fcad40c2a40 legacy=0x7fcad406c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.338 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40c1fa0 con 0x7fcad406edc0 2022-03-15T05:50:11.338 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1345219590 0 0) 0x7fcac40013f0 con 0x7fcad406edc0 2022-03-15T05:50:11.338 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 >> v1:172.21.15.164:6789/0 conn(0x7fcad406edc0 legacy=0x7fcad4066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.338 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 --2- 172.21.15.151:0/2259280713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcab8003a70 0x7fcab8003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.339 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 --2- 172.21.15.151:0/2259280713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcab8004690 0x7fcab8004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.339 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 --2- 172.21.15.151:0/2259280713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcab8005040 0x7fcab800b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.339 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad4067fd0 con 0x7fcab8004690 2022-03-15T05:50:11.339 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab800bed0 con 0x7fcab8003a70 2022-03-15T05:50:11.339 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab800c090 con 0x7fcab8005040 2022-03-15T05:50:11.340 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.318+0000 7fe46dfac700 1 -- 172.21.15.151:0/1611668755 wait complete. 2022-03-15T05:50:11.340 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7fe46dfac700 1 Processor -- start 2022-03-15T05:50:11.341 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.320+0000 7f2ef4eca700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2ed0063510 0x7f2ed00659c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009880 tx=0x7f2ee8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.341 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7fb33fd0b700 1 Processor -- start 2022-03-15T05:50:11.342 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.322+0000 7f2eeffff700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.151:6819/35554,v1:172.21.15.151:6821/35554] conn(0x7f2ed006bd70 0x7f2ed006e180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.342 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7fcada6e2700 1 --2- 172.21.15.151:0/2259280713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcab8005040 0x7fcab800b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.342 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.322+0000 7fcad96e0700 1 --2- 172.21.15.151:0/2259280713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcab8004690 0x7fcab8004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.343 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7fe46dfac700 1 -- start start 2022-03-15T05:50:11.343 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fe46dfac700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 0x7fe468152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.343 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fe46dfac700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe468150580 0x7fe46814d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.344 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fe46dfac700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe46814efc0 0x7fe46814dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.344 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fe46dfac700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe468159cb0 con 0x7fe468150580 2022-03-15T05:50:11.344 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fe46dfac700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4680c0030 con 0x7fe4540038e0 2022-03-15T05:50:11.344 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fe46dfac700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4681503d0 con 0x7fe46814efc0 2022-03-15T05:50:11.345 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7f2eecff9700 1 -- 172.21.15.151:0/2812347001 <== osd.1 v2:172.21.15.151:6819/35554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f2ed006e830 con 0x7f2ed006bd70 2022-03-15T05:50:11.345 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.322+0000 7fcada6e2700 1 -- 172.21.15.151:0/2259280713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcab8003a70 msgr2=0x7fcab8003e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-03-15T05:50:11.346 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fcada6e2700 1 --2- 172.21.15.151:0/2259280713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcab8003a70 0x7fcab8003e40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.346 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fcada6e2700 1 -- 172.21.15.151:0/2259280713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcab8004690 msgr2=0x7fcab8004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.346 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fcada6e2700 1 --2- 172.21.15.151:0/2259280713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcab8004690 0x7fcab8004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.346 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fcada6e2700 1 -- 172.21.15.151:0/2259280713 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad40c1fa0 con 0x7fcab8005040 2022-03-15T05:50:11.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fcada6e2700 1 -- 172.21.15.151:0/2259280713 reap_dead start 2022-03-15T05:50:11.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7f9bc77fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067c20 0x7f9bc006c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7f9bc77fe700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9bc0067390 0x7f9bc0150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.348 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7f9bc77fe700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bc00c4390 con 0x7f9bc0151530 2022-03-15T05:50:11.348 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7f9bc77fe700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bc006cfb0 con 0x7f9bc0067390 2022-03-15T05:50:11.348 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7f9bc77fe700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc0067ff0 con 0x7f9bc0067c20 2022-03-15T05:50:11.348 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7f9bc559a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067c20 0x7f9bc006c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.349 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7f9bc559a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067c20 0x7f9bc006c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60134/0 (socket says 172.21.15.151:60134) 2022-03-15T05:50:11.349 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7f9bc559a700 1 -- 172.21.15.151:0/367394558 learned_addr learned my addr 172.21.15.151:0/367394558 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.349 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.322+0000 7f9bc4d99700 1 --2- 172.21.15.151:0/367394558 >> v2:172.21.15.164:3300/0 conn(0x7f9bc0067390 0x7f9bc0150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.349 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7f9bc559a700 1 -- 172.21.15.151:0/367394558 >> v2:172.21.15.164:3300/0 conn(0x7f9bc0067390 msgr2=0x7f9bc0150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.350 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7f9bc559a700 1 --2- 172.21.15.151:0/367394558 >> v2:172.21.15.164:3300/0 conn(0x7f9bc0067390 0x7f9bc0150ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.350 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7f9bc559a700 1 -- 172.21.15.151:0/367394558 >> v1:172.21.15.164:6789/0 conn(0x7f9bc0151530 legacy=0x7f9bc006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.350 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7f9bc559a700 1 -- 172.21.15.151:0/367394558 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bc006c9f0 con 0x7f9bc0067c20 2022-03-15T05:50:11.350 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7f9bc559a700 1 --2- 172.21.15.151:0/367394558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067c20 0x7f9bc006c300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800ff90 tx=0x7f9bb800fbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdf19f4bac5f120f server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.351 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.321+0000 7fb33fd0b700 1 -- start start 2022-03-15T05:50:11.351 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.323+0000 7fb33fd0b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3380c4090 0x7fb3380c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.351 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fb33fd0b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb33806ced0 con 0x7fb338066b40 2022-03-15T05:50:11.351 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fb33fd0b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb338159740 con 0x7fb338067c20 2022-03-15T05:50:11.352 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fb33fd0b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb33806e510 con 0x7fb3380c4090 2022-03-15T05:50:11.352 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fe4677fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 0x7fe468152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.352 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fe4677fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 0x7fe468152160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57250/0 (socket says 172.21.15.151:57250) 2022-03-15T05:50:11.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fe4677fe700 1 -- 172.21.15.151:0/1345671465 learned_addr learned my addr 172.21.15.151:0/1345671465 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7f9bb7fff700 1 -- 172.21.15.151:0/367394558 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb800f0d0 con 0x7f9bc0067c20 2022-03-15T05:50:11.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7f9bb7fff700 1 -- 172.21.15.151:0/367394558 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb800f230 con 0x7f9bc0067c20 2022-03-15T05:50:11.354 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7f9bb7fff700 1 -- 172.21.15.151:0/367394558 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8009620 con 0x7f9bc0067c20 2022-03-15T05:50:11.355 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fb33d2a6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3380c4090 0x7fb3380c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.355 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7fb33d2a6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3380c4090 0x7fb3380c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60138/0 (socket says 172.21.15.151:60138) 2022-03-15T05:50:11.356 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7fb33d2a6700 1 -- 172.21.15.151:0/3461356875 learned_addr learned my addr 172.21.15.151:0/3461356875 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fe467fff700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe46814efc0 0x7fe46814dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fe4677fe700 1 -- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe46814efc0 msgr2=0x7fe46814dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fe4677fe700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fe46814efc0 0x7fe46814dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fe4677fe700 1 -- 172.21.15.151:0/1345671465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe468150580 msgr2=0x7fe46814d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fe4677fe700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe468150580 0x7fe46814d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.324+0000 7fe4677fe700 1 -- 172.21.15.151:0/1345671465 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468171d30 con 0x7fe4540038e0 2022-03-15T05:50:11.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7fe4677fe700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 0x7fe468152160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe45800cc30 tx=0x7fe458015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7f9bc77fe700 1 -- 172.21.15.151:0/367394558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067c20 msgr2=0x7f9bc006c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7f9bc77fe700 1 --2- 172.21.15.151:0/367394558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067c20 0x7f9bc006c300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800ff90 tx=0x7f9bb800fbf0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7f9bc77fe700 1 -- 172.21.15.151:0/367394558 shutdown_connections 2022-03-15T05:50:11.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7f9bc77fe700 1 --2- 172.21.15.151:0/367394558 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067c20 0x7f9bc006c300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7f9bc77fe700 1 --2- 172.21.15.151:0/367394558 >> v2:172.21.15.164:3300/0 conn(0x7f9bc0067390 0x7f9bc0150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7f9bc77fe700 1 -- 172.21.15.151:0/367394558 >> 172.21.15.151:0/367394558 conn(0x7f9bc00c75c0 msgr2=0x7f9bc00c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.326+0000 7fcada6e2700 1 --2- 172.21.15.151:0/2259280713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcab8005040 0x7fcab800b8e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcacc001aa0 tx=0x7fcacc007f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4f80c049ddc7d35 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.326+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc006a20 con 0x7fcab8005040 2022-03-15T05:50:11.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.326+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcacc006b80 con 0x7fcab8005040 2022-03-15T05:50:11.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.326+0000 7fcad8edf700 1 -- 172.21.15.151:0/2259280713 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcacc00c830 con 0x7fcab8005040 2022-03-15T05:50:11.362 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7f4208f8b700 1 Processor -- start 2022-03-15T05:50:11.362 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.326+0000 7f4208f8b700 1 -- start start 2022-03-15T05:50:11.363 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.325+0000 7fb33d2a6700 1 -- 172.21.15.151:0/3461356875 >> v1:172.21.15.164:6789/0 conn(0x7fb338067c20 legacy=0x7fb338155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.363 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.326+0000 7fb33d2a6700 1 -- 172.21.15.151:0/3461356875 >> v1:172.21.15.151:6789/0 conn(0x7fb338066b40 legacy=0x7fb338066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.363 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.326+0000 7fb33d2a6700 1 -- 172.21.15.151:0/3461356875 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3381599d0 con 0x7fb3380c4090 2022-03-15T05:50:11.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.326+0000 7fb33d2a6700 1 --2- 172.21.15.151:0/3461356875 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3380c4090 0x7fb3380c14f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3280097b0 tx=0x7fb3280090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7a213b7e4f49aec server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.327+0000 7fe44f7fe700 1 -- 172.21.15.151:0/1345671465 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe458001d20 con 0x7fe4540038e0 2022-03-15T05:50:11.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.327+0000 7fe44f7fe700 1 -- 172.21.15.151:0/1345671465 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4580012d0 con 0x7fe4540038e0 2022-03-15T05:50:11.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.327+0000 7fe44f7fe700 1 -- 172.21.15.151:0/1345671465 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45801e660 con 0x7fe4540038e0 2022-03-15T05:50:11.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.327+0000 7f9bc77fe700 1 -- 172.21.15.151:0/367394558 shutdown_connections 2022-03-15T05:50:11.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7f4208f8b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4204067c20 0x7f420406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7f4208f8b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4204067390 0x7f420406d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.367 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7f4208f8b700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4204150ff0 0x7f4204151470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.367 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7f4208f8b700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f420406cfb0 con 0x7f4204150ff0 2022-03-15T05:50:11.367 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7f4208f8b700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4204067ff0 con 0x7f4204067c20 2022-03-15T05:50:11.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.326+0000 7fb33caa5700 1 -- 172.21.15.151:0/3461356875 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb328004020 con 0x7fb3380c4090 2022-03-15T05:50:11.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.327+0000 7fb33caa5700 1 -- 172.21.15.151:0/3461356875 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb328004180 con 0x7fb3380c4090 2022-03-15T05:50:11.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.327+0000 7fb33caa5700 1 -- 172.21.15.151:0/3461356875 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb328011630 con 0x7fb3380c4090 2022-03-15T05:50:11.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7fb33fd0b700 1 -- 172.21.15.151:0/3461356875 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3380c4090 msgr2=0x7fb3380c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7fb33fd0b700 1 --2- 172.21.15.151:0/3461356875 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3380c4090 0x7fb3380c14f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb3280097b0 tx=0x7fb3280090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7fb33fd0b700 1 -- 172.21.15.151:0/3461356875 shutdown_connections 2022-03-15T05:50:11.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7fb33fd0b700 1 --2- 172.21.15.151:0/3461356875 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb3380c4090 0x7fb3380c14f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7fb33fd0b700 1 -- 172.21.15.151:0/3461356875 >> 172.21.15.151:0/3461356875 conn(0x7fb3380c75c0 msgr2=0x7fb3380c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7f420259c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4204067c20 0x7f420406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7f420259c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4204067c20 0x7f420406c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57252/0 (socket says 172.21.15.151:57252) 2022-03-15T05:50:11.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7f420259c700 1 -- 172.21.15.151:0/2274757539 learned_addr learned my addr 172.21.15.151:0/2274757539 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.327+0000 7fcadc145700 1 -- 172.21.15.151:0/2259280713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcab8005040 msgr2=0x7fcab800b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.327+0000 7fcadc145700 1 --2- 172.21.15.151:0/2259280713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcab8005040 0x7fcab800b8e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcacc001aa0 tx=0x7fcacc007f30 comp rx=0 tx=0).stop 2022-03-15T05:50:11.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.328+0000 7fb33fd0b700 1 -- 172.21.15.151:0/3461356875 shutdown_connections 2022-03-15T05:50:11.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.329+0000 7fb33fd0b700 1 -- 172.21.15.151:0/3461356875 wait complete. 2022-03-15T05:50:11.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.329+0000 7f4208f8b700 1 -- 172.21.15.151:0/2274757539 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42041508c0 con 0x7f4204067390 2022-03-15T05:50:11.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.329+0000 7f420259c700 1 -- 172.21.15.151:0/2274757539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4204067390 msgr2=0x7f420406d320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-03-15T05:50:11.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.329+0000 7f4202d9d700 1 --2- 172.21.15.151:0/2274757539 >> v2:172.21.15.151:3300/0 conn(0x7f4204150ff0 0x7f4204151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.329+0000 7f420259c700 1 --2- 172.21.15.151:0/2274757539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4204067390 0x7f420406d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.329+0000 7f420259c700 1 -- 172.21.15.151:0/2274757539 >> v2:172.21.15.151:3300/0 conn(0x7f4204150ff0 msgr2=0x7f4204151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.375 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.329+0000 7f420259c700 1 --2- 172.21.15.151:0/2274757539 >> v2:172.21.15.151:3300/0 conn(0x7f4204150ff0 0x7f4204151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.375 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.329+0000 7f420259c700 1 -- 172.21.15.151:0/2274757539 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42040c14f0 con 0x7f4204067c20 2022-03-15T05:50:11.375 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.329+0000 7f4202d9d700 1 --2- 172.21.15.151:0/2274757539 >> v2:172.21.15.151:3300/0 conn(0x7f4204150ff0 0x7f4204151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-15T05:50:11.376 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.327+0000 7f9bc77fe700 1 -- 172.21.15.151:0/367394558 wait complete. 2022-03-15T05:50:11.376 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.330+0000 7f420259c700 1 --2- 172.21.15.151:0/2274757539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4204067c20 0x7f420406c300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4204069540 tx=0x7f41ec0090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eefce3167d51ef48 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.330+0000 7f9bc77fe700 1 Processor -- start 2022-03-15T05:50:11.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.330+0000 7f9bc77fe700 1 -- start start 2022-03-15T05:50:11.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.330+0000 7f420159a700 1 -- 172.21.15.151:0/2274757539 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec004030 con 0x7f4204067c20 2022-03-15T05:50:11.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.330+0000 7f420159a700 1 -- 172.21.15.151:0/2274757539 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41ec0041b0 con 0x7f4204067c20 2022-03-15T05:50:11.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.330+0000 7f420159a700 1 -- 172.21.15.151:0/2274757539 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41ec011630 con 0x7f4204067c20 2022-03-15T05:50:11.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.331+0000 7fb33fd0b700 1 Processor -- start 2022-03-15T05:50:11.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.331+0000 7f4208f8b700 1 -- 172.21.15.151:0/2274757539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4204067c20 msgr2=0x7f420406c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.331+0000 7f4208f8b700 1 --2- 172.21.15.151:0/2274757539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4204067c20 0x7f420406c300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4204069540 tx=0x7f41ec0090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.331+0000 7f9bc77fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067390 0x7f9bc00c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7f9bc77fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bc0067c20 0x7f9bc0153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7f9bc77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bc0151530 0x7f9bc013f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7f9bc77fe700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc0161180 con 0x7f9bc0151530 2022-03-15T05:50:11.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7f9bc77fe700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc0160c50 con 0x7f9bc0067c20 2022-03-15T05:50:11.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7f9bc77fe700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bc0153370 con 0x7f9bc0067390 2022-03-15T05:50:11.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7f4208f8b700 1 -- 172.21.15.151:0/2274757539 shutdown_connections 2022-03-15T05:50:11.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7f4208f8b700 1 --2- 172.21.15.151:0/2274757539 >> v2:172.21.15.151:3300/0 conn(0x7f4204150ff0 0x7f4204151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7f4208f8b700 1 --2- 172.21.15.151:0/2274757539 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4204067c20 0x7f420406c300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7f4208f8b700 1 --2- 172.21.15.151:0/2274757539 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4204067390 0x7f420406d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7f4208f8b700 1 -- 172.21.15.151:0/2274757539 >> 172.21.15.151:0/2274757539 conn(0x7f42040c75c0 msgr2=0x7f42040c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.384 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.331+0000 7fb33fd0b700 1 -- start start 2022-03-15T05:50:11.384 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7fb33fd0b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb338066b40 0x7fb3380b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.384 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7fb33fd0b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb338067c20 0x7fb3380c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.385 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7fb33fd0b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3380c4090 0x7fb3380bcad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.385 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7fb33fd0b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb338159cb0 con 0x7fb338066b40 2022-03-15T05:50:11.385 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7fb33fd0b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb338168b00 con 0x7fb3380c4090 2022-03-15T05:50:11.385 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7fb33fd0b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb338168de0 con 0x7fb338067c20 2022-03-15T05:50:11.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.331+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe468150b40 con 0x7fe4540038e0 2022-03-15T05:50:11.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.331+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe468171400 con 0x7fe4540038e0 2022-03-15T05:50:11.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.332+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe4680704b0 con 0x7fe4540038e0 2022-03-15T05:50:11.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.333+0000 7f4208f8b700 1 -- 172.21.15.151:0/2274757539 shutdown_connections 2022-03-15T05:50:11.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.333+0000 7fb33d2a6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb338067c20 0x7fb3380c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.333+0000 7fb33d2a6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb338067c20 0x7fb3380c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60144/0 (socket says 172.21.15.151:60144) 2022-03-15T05:50:11.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.333+0000 7fb33d2a6700 1 -- 172.21.15.151:0/1003075319 learned_addr learned my addr 172.21.15.151:0/1003075319 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.333+0000 7fb33daa7700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb338066b40 0x7fb3380b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.333+0000 7f4208f8b700 1 -- 172.21.15.151:0/2274757539 wait complete. 2022-03-15T05:50:11.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.333+0000 7fcadc145700 1 -- 172.21.15.151:0/2259280713 shutdown_connections 2022-03-15T05:50:11.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.333+0000 7fcadc145700 1 --2- 172.21.15.151:0/2259280713 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcab8005040 0x7fcab800b8e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.333+0000 7fcadc145700 1 -- 172.21.15.151:0/2259280713 >> 172.21.15.151:0/2259280713 conn(0x7fcad40c75c0 msgr2=0x7fcad40c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.334+0000 7f9bc559a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067390 0x7f9bc00c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.334+0000 7f9bc559a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067390 0x7f9bc00c3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60142/0 (socket says 172.21.15.151:60142) 2022-03-15T05:50:11.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.334+0000 7f9bc559a700 1 -- 172.21.15.151:0/812291287 learned_addr learned my addr 172.21.15.151:0/812291287 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.334+0000 7f9bc4d99700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bc0067c20 0x7f9bc0153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.334+0000 7fb33e2a8700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3380c4090 0x7fb3380bcad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.335+0000 7f4208f8b700 1 Processor -- start 2022-03-15T05:50:11.393 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.335+0000 7f9bc5d9b700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bc0151530 0x7f9bc013f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.393 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7fb33daa7700 1 -- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb338067c20 msgr2=0x7fb3380c5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.394 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7fb33daa7700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fb338067c20 0x7fb3380c5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.394 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7fb33daa7700 1 -- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3380c4090 msgr2=0x7fb3380bcad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.394 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7fb33daa7700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb3380c4090 0x7fb3380bcad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.394 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7fb33daa7700 1 -- 172.21.15.151:0/1003075319 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb328009370 con 0x7fb338066b40 2022-03-15T05:50:11.395 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.337+0000 7fcadc145700 1 -- 172.21.15.151:0/2259280713 shutdown_connections 2022-03-15T05:50:11.395 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7f9bc4d99700 1 -- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067390 msgr2=0x7f9bc00c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.396 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7f9bc4d99700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9bc0067390 0x7f9bc00c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.396 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7f9bc4d99700 1 -- 172.21.15.151:0/812291287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bc0151530 msgr2=0x7f9bc013f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.396 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7f9bc4d99700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bc0151530 0x7f9bc013f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.396 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7f9bc4d99700 1 -- 172.21.15.151:0/812291287 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bb80140e0 con 0x7f9bc0067c20 2022-03-15T05:50:11.397 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.337+0000 7f9bc4d99700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bc0067c20 0x7f9bc0153800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000d860 tx=0x7f9bb0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.397 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.335+0000 7f4208f8b700 1 -- start start 2022-03-15T05:50:11.398 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.337+0000 7fb33daa7700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb338066b40 0x7fb3380b7170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c440 tx=0x7fb334007d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.398 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.337+0000 7f4208f8b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4204067390 0x7f420416c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.399 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.337+0000 7f4208f8b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4204067c20 0x7f4204069f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.399 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.336+0000 7fe44f7fe700 1 -- 172.21.15.151:0/1345671465 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fe458010070 con 0x7fe4540038e0 2022-03-15T05:50:11.399 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7f6f1d05d700 1 Processor -- start 2022-03-15T05:50:11.400 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7fe44f7fe700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe448063510 0x7fe4480659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.400 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7fe44f7fe700 1 -- 172.21.15.151:0/1345671465 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe458081f10 con 0x7fe4540038e0 2022-03-15T05:50:11.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7f6f1d05d700 1 -- start start 2022-03-15T05:50:11.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7fe44f7fe700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.151:6800/35552,v1:172.21.15.151:6801/35552] conn(0x7fe44806bee0 0x7fe44806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7fe44f7fe700 1 -- 172.21.15.151:0/1345671465 --> [v2:172.21.15.151:6800/35552,v1:172.21.15.151:6801/35552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe44806e9a0 con 0x7fe44806bee0 2022-03-15T05:50:11.402 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7fe44f7fe700 1 -- 172.21.15.151:0/1345671465 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe458082240 con 0x7fe4540038e0 2022-03-15T05:50:11.402 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.337+0000 7fcadc145700 1 -- 172.21.15.151:0/2259280713 wait complete. 2022-03-15T05:50:11.403 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7f9bb57fa700 1 -- 172.21.15.151:0/812291287 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb0004240 con 0x7f9bc0067c20 2022-03-15T05:50:11.403 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.339+0000 7fe466ffd700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe448063510 0x7fe4480659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.404 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7f9bb57fa700 1 -- 172.21.15.151:0/812291287 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bb00043a0 con 0x7f9bc0067c20 2022-03-15T05:50:11.404 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7f9bb57fa700 1 -- 172.21.15.151:0/812291287 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bb00036f0 con 0x7f9bc0067c20 2022-03-15T05:50:11.404 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bc01481d0 con 0x7f9bc0067c20 2022-03-15T05:50:11.404 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bc0152100 con 0x7f9bc0067c20 2022-03-15T05:50:11.405 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.339+0000 7fcadc145700 1 Processor -- start 2022-03-15T05:50:11.405 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.339+0000 7fb325ffb700 1 -- 172.21.15.151:0/1003075319 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334012420 con 0x7fb338066b40 2022-03-15T05:50:11.406 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.339+0000 7fb325ffb700 1 -- 172.21.15.151:0/1003075319 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb334012580 con 0x7fb338066b40 2022-03-15T05:50:11.406 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.339+0000 7fb325ffb700 1 -- 172.21.15.151:0/1003075319 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb334012900 con 0x7fb338066b40 2022-03-15T05:50:11.407 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.339+0000 7fe467fff700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.151:6800/35552,v1:172.21.15.151:6801/35552] conn(0x7fe44806bee0 0x7fe44806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.407 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.340+0000 7fe466ffd700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe448063510 0x7fe4480659c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe468150950 tx=0x7fe45c009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.407 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.340+0000 7fe467fff700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.151:6800/35552,v1:172.21.15.151:6801/35552] conn(0x7fe44806bee0 0x7fe44806e2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.408 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.340+0000 7fcadc145700 1 -- start start 2022-03-15T05:50:11.408 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7fcadc145700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcab8005040 0x7fcad415f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.409 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7fcadc145700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcad415f8b0 0x7fcad40c54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.409 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7fcadc145700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcad415c6b0 0x7fcad40c59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.409 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7fcadc145700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40c0190 con 0x7fcad415c6b0 2022-03-15T05:50:11.409 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7fcadc145700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad40bfbd0 con 0x7fcab8005040 2022-03-15T05:50:11.410 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7fcadc145700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad415d930 con 0x7fcad415f8b0 2022-03-15T05:50:11.410 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7fcad96e0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcad415f8b0 0x7fcad40c54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.410 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7fcad9ee1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcab8005040 0x7fcad415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.410 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7fcad9ee1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcab8005040 0x7fcad415f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57262/0 (socket says 172.21.15.151:57262) 2022-03-15T05:50:11.411 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7fcad9ee1700 1 -- 172.21.15.151:0/1736398217 learned_addr learned my addr 172.21.15.151:0/1736398217 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.411 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.342+0000 7fcad9ee1700 1 -- 172.21.15.151:0/1736398217 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcad415f8b0 msgr2=0x7fcad40c54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.411 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.342+0000 7fcad9ee1700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fcad415f8b0 0x7fcad40c54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.411 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.342+0000 7fcad9ee1700 1 -- 172.21.15.151:0/1736398217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcad415c6b0 msgr2=0x7fcad40c59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.412 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.342+0000 7fcad9ee1700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcad415c6b0 0x7fcad40c59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.412 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.342+0000 7fcad9ee1700 1 -- 172.21.15.151:0/1736398217 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4171920 con 0x7fcab8005040 2022-03-15T05:50:11.412 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.342+0000 7f9bb57fa700 1 -- 172.21.15.151:0/812291287 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f9bb0003a60 con 0x7f9bc0067c20 2022-03-15T05:50:11.413 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.342+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3381690c0 con 0x7fb338066b40 2022-03-15T05:50:11.413 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.342+0000 7fcad9ee1700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcab8005040 0x7fcad415f370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcad0006fd0 tx=0x7fcad00090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.414 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.343+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb338169680 con 0x7fb338066b40 2022-03-15T05:50:11.414 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.343+0000 7fcac9ffb700 1 -- 172.21.15.151:0/1736398217 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0013680 con 0x7fcab8005040 2022-03-15T05:50:11.415 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.343+0000 7fcac9ffb700 1 -- 172.21.15.151:0/1736398217 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad0013800 con 0x7fcab8005040 2022-03-15T05:50:11.415 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.343+0000 7fcac9ffb700 1 -- 172.21.15.151:0/1736398217 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcad0013bc0 con 0x7fcab8005040 2022-03-15T05:50:11.415 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.343+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad415c480 con 0x7fcab8005040 2022-03-15T05:50:11.415 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.343+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad40bfe20 con 0x7fcab8005040 2022-03-15T05:50:11.416 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.344+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcad40bd620 con 0x7fcab8005040 2022-03-15T05:50:11.416 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.340+0000 7f6f1d05d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6f18069f50 0x7f6f180c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.417 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.340+0000 7f6f1d05d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f180c1410 0x7f6f180bff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.417 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.340+0000 7f6f1d05d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f18153d60 con 0x7f6f180c2ed0 2022-03-15T05:50:11.417 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.340+0000 7f6f1d05d700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1806e3c0 con 0x7f6f18069f50 2022-03-15T05:50:11.417 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.340+0000 7f6f1d05d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180c1d70 con 0x7f6f180c1410 2022-03-15T05:50:11.417 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7f6f1c85c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f6f180c2ed0 0x7f6f18066d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53196/0 (socket says 172.21.15.151:53196) 2022-03-15T05:50:11.418 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.341+0000 7f6f1c85c700 1 -- 172.21.15.151:0/3130499431 learned_addr learned my addr 172.21.15.151:0/3130499431 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:11.418 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.343+0000 7f6f177fe700 1 -- 172.21.15.151:0/3130499431 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534319461 0 0) 0x7f6f18153d60 con 0x7f6f180c2ed0 2022-03-15T05:50:11.418 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.343+0000 7f6f177fe700 1 -- 172.21.15.151:0/3130499431 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ef80033f0 con 0x7f6f180c2ed0 2022-03-15T05:50:11.419 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.343+0000 7f6f0f7fe700 1 --2- 172.21.15.151:0/3130499431 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f180c1410 0x7f6f180bff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.419 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.344+0000 7f6f17fff700 1 --2- 172.21.15.151:0/3130499431 >> v2:172.21.15.164:3300/0 conn(0x7f6f18069f50 0x7f6f180c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.419 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.344+0000 7f6f0f7fe700 1 -- 172.21.15.151:0/3130499431 >> v2:172.21.15.164:3300/0 conn(0x7f6f18069f50 msgr2=0x7f6f180c1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.419 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.344+0000 7f6f0f7fe700 1 --2- 172.21.15.151:0/3130499431 >> v2:172.21.15.164:3300/0 conn(0x7f6f18069f50 0x7f6f180c1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.420 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.344+0000 7f6f0f7fe700 1 -- 172.21.15.151:0/3130499431 >> v1:172.21.15.151:6789/0 conn(0x7f6f180c2ed0 legacy=0x7f6f18066d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.420 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.344+0000 7f6f0f7fe700 1 -- 172.21.15.151:0/3130499431 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18154040 con 0x7f6f180c1410 2022-03-15T05:50:11.420 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.344+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb314000fd0 con 0x7fb338066b40 2022-03-15T05:50:11.421 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.338+0000 7f420259c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4204067390 0x7f420416c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.421 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.345+0000 7f4208f8b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4204150ff0 0x7f4204168bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.421 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.345+0000 7f4208f8b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420416bb90 con 0x7f4204150ff0 2022-03-15T05:50:11.421 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.345+0000 7f4208f8b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f420416be30 con 0x7f4204067c20 2022-03-15T05:50:11.422 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.345+0000 7f4208f8b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42040c55f0 con 0x7f4204067390 2022-03-15T05:50:11.422 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.345+0000 7fe44f7fe700 1 -- 172.21.15.151:0/1345671465 <== osd.0 v2:172.21.15.151:6800/35552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7fe44806e9a0 con 0x7fe44806bee0 2022-03-15T05:50:11.423 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.345+0000 7f9bb57fa700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ba00634e0 0x7f9ba0065990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.423 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.345+0000 7f9bb57fa700 1 -- 172.21.15.151:0/812291287 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9bb007ff80 con 0x7f9bc0067c20 2022-03-15T05:50:11.423 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f9bc559a700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ba00634e0 0x7f9ba0065990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.423 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f9bc77fe700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.151:6808/35553,v1:172.21.15.151:6809/35553] conn(0x7f9bc00c36a0 0x7f9bc014ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.424 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 --> [v2:172.21.15.151:6808/35553,v1:172.21.15.151:6809/35553] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9bc004b760 con 0x7f9bc00c36a0 2022-03-15T05:50:11.424 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.345+0000 7f4201d9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4204067c20 0x7f4204069f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.424 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.345+0000 7f4201d9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4204067c20 0x7f4204069f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57260/0 (socket says 172.21.15.151:57260) 2022-03-15T05:50:11.425 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f4201d9b700 1 -- 172.21.15.151:0/3517672556 learned_addr learned my addr 172.21.15.151:0/3517672556 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.425 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f4202d9d700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4204150ff0 0x7f4204168bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.425 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f4202d9d700 1 -- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4204067390 msgr2=0x7f420416c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.425 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f4202d9d700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4204067390 0x7f420416c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.425 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f4202d9d700 1 -- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4204067c20 msgr2=0x7f4204069f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.426 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f4202d9d700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4204067c20 0x7f4204069f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.426 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f4202d9d700 1 -- 172.21.15.151:0/3517672556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41ec009370 con 0x7f4204150ff0 2022-03-15T05:50:11.426 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.347+0000 7f4202d9d700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4204150ff0 0x7f4204168bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00c5b0 tx=0x7f41fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.427 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.345+0000 7f4305eb7700 1 Processor -- start 2022-03-15T05:50:11.427 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f4305eb7700 1 -- start start 2022-03-15T05:50:11.427 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.348+0000 7f4305eb7700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f43000c4090 0x7f43000c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.427 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.348+0000 7f4305eb7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300067c20 0x7f430006d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.428 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.348+0000 7f4305eb7700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430006ced0 con 0x7f4300066b40 2022-03-15T05:50:11.428 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.348+0000 7f4305eb7700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f430006e510 con 0x7f43000c4090 2022-03-15T05:50:11.428 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.348+0000 7f4305eb7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4300159cb0 con 0x7f4300067c20 2022-03-15T05:50:11.429 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.347+0000 7fb325ffb700 1 -- 172.21.15.151:0/1003075319 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fb334010050 con 0x7fb338066b40 2022-03-15T05:50:11.429 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.346+0000 7f6f0f7fe700 1 --2- 172.21.15.151:0/3130499431 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f180c1410 0x7f6f180bff60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f00008760 tx=0x7f6f000080e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5cb6a4ac4343469 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.429 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.347+0000 7f6f177fe700 1 -- 172.21.15.151:0/3130499431 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f00010070 con 0x7f6f180c1410 2022-03-15T05:50:11.429 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.347+0000 7f6f177fe700 1 -- 172.21.15.151:0/3130499431 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f00004030 con 0x7f6f180c1410 2022-03-15T05:50:11.430 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.347+0000 7f6f177fe700 1 -- 172.21.15.151:0/3130499431 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f000043f0 con 0x7f6f180c1410 2022-03-15T05:50:11.430 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.348+0000 7f6f1d05d700 1 -- 172.21.15.151:0/3130499431 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f180c1410 msgr2=0x7f6f180bff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.430 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.348+0000 7f6f1d05d700 1 --2- 172.21.15.151:0/3130499431 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f180c1410 0x7f6f180bff60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6f00008760 tx=0x7f6f000080e0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.431 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.348+0000 7f41fa7fc700 1 -- 172.21.15.151:0/3517672556 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc004240 con 0x7f4204150ff0 2022-03-15T05:50:11.431 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.348+0000 7f41fa7fc700 1 -- 172.21.15.151:0/3517672556 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41fc0043c0 con 0x7f4204150ff0 2022-03-15T05:50:11.431 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.348+0000 7f41fa7fc700 1 -- 172.21.15.151:0/3517672556 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41fc003710 con 0x7f4204150ff0 2022-03-15T05:50:11.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.349+0000 7f42ff7fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f4300066b40 0x7f4300066f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33662/0 (socket says 172.21.15.151:33662) 2022-03-15T05:50:11.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.349+0000 7f42ff7fe700 1 -- 172.21.15.151:0/257225940 learned_addr learned my addr 172.21.15.151:0/257225940 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:11.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.349+0000 7fb325ffb700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fb318063510 0x7fb3180659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.349+0000 7fb325ffb700 1 -- 172.21.15.151:0/1003075319 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb33407fe30 con 0x7fb338066b40 2022-03-15T05:50:11.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.349+0000 7fb325ffb700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:6814/41129,v1:172.21.15.164:6817/41129] conn(0x7fb31806bee0 0x7fb31806e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.349+0000 7fb325ffb700 1 -- 172.21.15.151:0/1003075319 --> [v2:172.21.15.164:6814/41129,v1:172.21.15.164:6817/41129] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb31806e9a0 con 0x7fb31806bee0 2022-03-15T05:50:11.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.349+0000 7fb325ffb700 1 -- 172.21.15.151:0/1003075319 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb334080160 con 0x7fb338066b40 2022-03-15T05:50:11.434 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.349+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42040c4a70 con 0x7f4204150ff0 2022-03-15T05:50:11.434 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.349+0000 7f42fffff700 1 --2- 172.21.15.151:0/257225940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300067c20 0x7f430006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.435 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42040c5030 con 0x7f4204150ff0 2022-03-15T05:50:11.435 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7fb33d2a6700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fb318063510 0x7fb3180659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.436 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7f6f1d05d700 1 -- 172.21.15.151:0/3130499431 shutdown_connections 2022-03-15T05:50:11.436 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7f6f1d05d700 1 --2- 172.21.15.151:0/3130499431 >> v2:172.21.15.164:3300/0 conn(0x7f6f18069f50 0x7f6f180c1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.436 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7f6f1d05d700 1 --2- 172.21.15.151:0/3130499431 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f180c1410 0x7f6f180bff60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.436 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7f6f1d05d700 1 -- 172.21.15.151:0/3130499431 >> 172.21.15.151:0/3130499431 conn(0x7f6f18068320 msgr2=0x7f6f18068720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.437 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7f42fffff700 1 -- 172.21.15.151:0/257225940 >> v2:172.21.15.151:3300/0 conn(0x7f43000c4090 msgr2=0x7f43000c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.437 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7f42fffff700 1 --2- 172.21.15.151:0/257225940 >> v2:172.21.15.151:3300/0 conn(0x7f43000c4090 0x7f43000c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.437 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7f42fffff700 1 -- 172.21.15.151:0/257225940 >> v1:172.21.15.164:6789/0 conn(0x7f4300066b40 legacy=0x7f4300066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.438 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7f42fffff700 1 -- 172.21.15.151:0/257225940 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430006d8a0 con 0x7f4300067c20 2022-03-15T05:50:11.438 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7f9bc5d9b700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.151:6808/35553,v1:172.21.15.151:6809/35553] conn(0x7f9bc00c36a0 0x7f9bc014ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.438 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7f9bc5d9b700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.151:6808/35553,v1:172.21.15.151:6809/35553] conn(0x7f9bc00c36a0 0x7f9bc014ff70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.439 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7fb33d2a6700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fb318063510 0x7fb3180659c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb328009310 tx=0x7fb328016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.439 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7f42fffff700 1 --2- 172.21.15.151:0/257225940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300067c20 0x7f430006d360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009e60 tx=0x7f42f8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=88cb82602e8d279c server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.440 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7f42fe7fc700 1 -- 172.21.15.151:0/257225940 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f800e070 con 0x7f4300067c20 2022-03-15T05:50:11.440 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7f9bc559a700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ba00634e0 0x7f9ba0065990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800f890 tx=0x7f9bb800c000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.441 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7f42fe7fc700 1 -- 172.21.15.151:0/257225940 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f800bc30 con 0x7f4300067c20 2022-03-15T05:50:11.441 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7f42fe7fc700 1 -- 172.21.15.151:0/257225940 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8012430 con 0x7f4300067c20 2022-03-15T05:50:11.441 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7f6f1d05d700 1 -- 172.21.15.151:0/3130499431 shutdown_connections 2022-03-15T05:50:11.443 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.349+0000 7fcac9ffb700 1 -- 172.21.15.151:0/1736398217 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fcad0019030 con 0x7fcab8005040 2022-03-15T05:50:11.443 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7fcac9ffb700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcabc063540 0x7fcabc0659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.443 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.350+0000 7fcac9ffb700 1 -- 172.21.15.151:0/1736398217 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcad007fdb0 con 0x7fcab8005040 2022-03-15T05:50:11.443 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7fcac9ffb700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.151:6816/35555,v1:172.21.15.151:6817/35555] conn(0x7fcabc06bf10 0x7fcabc06e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.444 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7fcac9ffb700 1 -- 172.21.15.151:0/1736398217 --> [v2:172.21.15.151:6816/35555,v1:172.21.15.151:6817/35555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcabc06e9d0 con 0x7fcabc06bf10 2022-03-15T05:50:11.444 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.351+0000 7fcac9ffb700 1 -- 172.21.15.151:0/1736398217 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcad00800e0 con 0x7fcab8005040 2022-03-15T05:50:11.444 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.352+0000 7f4305eb7700 1 -- 172.21.15.151:0/257225940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300067c20 msgr2=0x7f430006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.445 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.352+0000 7f4305eb7700 1 --2- 172.21.15.151:0/257225940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300067c20 0x7f430006d360 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42f8009e60 tx=0x7f42f8009780 comp rx=0 tx=0).stop 2022-03-15T05:50:11.445 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.352+0000 7fb33e2a8700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:6814/41129,v1:172.21.15.164:6817/41129] conn(0x7fb31806bee0 0x7fb31806e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.446 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.352+0000 7f6f1d05d700 1 -- 172.21.15.151:0/3130499431 wait complete. 2022-03-15T05:50:11.446 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.353+0000 7fcad96e0700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcabc063540 0x7fcabc0659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.447 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.353+0000 7f4305eb7700 1 -- 172.21.15.151:0/257225940 shutdown_connections 2022-03-15T05:50:11.447 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.353+0000 7f4305eb7700 1 --2- 172.21.15.151:0/257225940 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4300067c20 0x7f430006d360 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.447 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.353+0000 7f4305eb7700 1 --2- 172.21.15.151:0/257225940 >> v2:172.21.15.151:3300/0 conn(0x7f43000c4090 0x7f43000c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.448 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.353+0000 7f4305eb7700 1 -- 172.21.15.151:0/257225940 >> 172.21.15.151:0/257225940 conn(0x7f43000c75c0 msgr2=0x7f43000c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.448 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.353+0000 7fcada6e2700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.151:6816/35555,v1:172.21.15.151:6817/35555] conn(0x7fcabc06bf10 0x7fcabc06e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.448 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.353+0000 7fb33e2a8700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:6814/41129,v1:172.21.15.164:6817/41129] conn(0x7fb31806bee0 0x7fb31806e2f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.449 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.353+0000 7f4305eb7700 1 -- 172.21.15.151:0/257225940 shutdown_connections 2022-03-15T05:50:11.449 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.354+0000 7f4305eb7700 1 -- 172.21.15.151:0/257225940 wait complete. 2022-03-15T05:50:11.450 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.354+0000 7fcad96e0700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcabc063540 0x7fcabc0659f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcad4070520 tx=0x7fcac4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.450 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.354+0000 7fb325ffb700 1 -- 172.21.15.151:0/1003075319 <== osd.6 v2:172.21.15.164:6814/41129 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7fb31806e9a0 con 0x7fb31806bee0 2022-03-15T05:50:11.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.354+0000 7f6f1d05d700 1 Processor -- start 2022-03-15T05:50:11.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.354+0000 7fcada6e2700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.151:6816/35555,v1:172.21.15.151:6817/35555] conn(0x7fcabc06bf10 0x7fcabc06e320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.452 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.352+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42040c3b60 con 0x7f4204150ff0 2022-03-15T05:50:11.452 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.353+0000 7f41fa7fc700 1 -- 172.21.15.151:0/3517672556 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f41fc021070 con 0x7f4204150ff0 2022-03-15T05:50:11.452 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.355+0000 7f41fa7fc700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f41e8063510 0x7f41e80659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.453 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.355+0000 7f41fa7fc700 1 -- 172.21.15.151:0/3517672556 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f41fc07fb00 con 0x7f4204150ff0 2022-03-15T05:50:11.453 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.355+0000 7f41fa7fc700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:6824/41130,v1:172.21.15.164:6825/41130] conn(0x7f41e806be60 0x7f41e806e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.453 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.355+0000 7f41fa7fc700 1 -- 172.21.15.151:0/3517672556 --> [v2:172.21.15.164:6824/41130,v1:172.21.15.164:6825/41130] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f41e806e920 con 0x7f41e806be60 2022-03-15T05:50:11.454 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.356+0000 7f4201d9b700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:6824/41130,v1:172.21.15.164:6825/41130] conn(0x7f41e806be60 0x7f41e806e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.454 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.356+0000 7f420259c700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f41e8063510 0x7f41e80659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.454 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.356+0000 7f4305eb7700 1 Processor -- start 2022-03-15T05:50:11.455 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.357+0000 7f41fa7fc700 1 -- 172.21.15.151:0/3517672556 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f41fc081ea0 con 0x7f4204150ff0 2022-03-15T05:50:11.456 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.355+0000 7f6f1d05d700 1 -- start start 2022-03-15T05:50:11.456 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.356+0000 7f6f1d05d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f18069f50 0x7f6f1814a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.456 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.356+0000 7f6f1d05d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f180c1410 0x7f6f18163b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.456 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.356+0000 7f6f1d05d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f180c2ed0 0x7f6f18164080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.457 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.356+0000 7f6f1d05d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180b3f40 con 0x7f6f180c1410 2022-03-15T05:50:11.457 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.356+0000 7f6f1d05d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f181636b0 con 0x7f6f180c2ed0 2022-03-15T05:50:11.457 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.356+0000 7f6f1d05d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18151cd0 con 0x7f6f18069f50 2022-03-15T05:50:11.457 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.357+0000 7f420259c700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f41e8063510 0x7f41e80659c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4204069540 tx=0x7f41ec016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.458 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.354+0000 7f9bb57fa700 1 -- 172.21.15.151:0/812291287 <== osd.3 v2:172.21.15.151:6808/35553 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f9bc004b760 con 0x7f9bc00c36a0 2022-03-15T05:50:11.458 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.357+0000 7f4201d9b700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:6824/41130,v1:172.21.15.164:6825/41130] conn(0x7f41e806be60 0x7f41e806e270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.459 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.357+0000 7fcac9ffb700 1 -- 172.21.15.151:0/1736398217 <== osd.2 v2:172.21.15.151:6816/35555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7fcabc06e9d0 con 0x7fcabc06bf10 2022-03-15T05:50:11.459 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.357+0000 7f4305eb7700 1 -- start start 2022-03-15T05:50:11.460 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.358+0000 7f41fa7fc700 1 -- 172.21.15.151:0/3517672556 <== osd.4 v2:172.21.15.164:6824/41130 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f41e806e920 con 0x7f41e806be60 2022-03-15T05:50:11.461 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.358+0000 7f4305eb7700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4300066b40 0x7f43000bc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.461 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.358+0000 7f4305eb7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4300067c20 0x7f43000bc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.461 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.358+0000 7f4305eb7700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43000c4090 0x7f43000b5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.461 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.358+0000 7f4305eb7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43000bbaa0 con 0x7f4300067c20 2022-03-15T05:50:11.462 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.358+0000 7f4305eb7700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43000b5790 con 0x7f4300066b40 2022-03-15T05:50:11.462 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.358+0000 7f4305eb7700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43000baa10 con 0x7f43000c4090 2022-03-15T05:50:11.462 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.359+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 --> [v2:172.21.15.151:6819/35554,v1:172.21.15.151:6821/35554] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ef004b760 con 0x7f2ed006bd70 2022-03-15T05:50:11.463 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.359+0000 7f42fffff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43000c4090 0x7f43000b5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.463 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.359+0000 7f42fffff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43000c4090 0x7f43000b5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60156/0 (socket says 172.21.15.151:60156) 2022-03-15T05:50:11.464 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.359+0000 7f42fffff700 1 -- 172.21.15.151:0/3253469873 learned_addr learned my addr 172.21.15.151:0/3253469873 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.464 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.360+0000 7f42ff7fe700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4300066b40 0x7f43000bc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.464 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.360+0000 7f2eecff9700 1 -- 172.21.15.151:0/2812347001 <== osd.1 v2:172.21.15.151:6819/35554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2ef004b760 con 0x7f2ed006bd70 2022-03-15T05:50:11.465 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.360+0000 7f42ff7fe700 1 -- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43000c4090 msgr2=0x7f43000b5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.465 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.360+0000 7f42ff7fe700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f43000c4090 0x7f43000b5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.465 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.360+0000 7f42ff7fe700 1 -- 172.21.15.151:0/3253469873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4300067c20 msgr2=0x7f43000bc660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.466 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.360+0000 7f42ff7fe700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4300067c20 0x7f43000bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.466 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.360+0000 7f42ff7fe700 1 -- 172.21.15.151:0/3253469873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f8009a20 con 0x7f4300066b40 2022-03-15T05:50:11.466 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.358+0000 7f6f0f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f180c1410 0x7f6f18163b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.467 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.358+0000 7f6f0f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f180c1410 0x7f6f18163b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60044/0 (socket says 172.21.15.151:60044) 2022-03-15T05:50:11.467 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.358+0000 7f6f0f7fe700 1 -- 172.21.15.151:0/4110219883 learned_addr learned my addr 172.21.15.151:0/4110219883 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.467 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.359+0000 7f6f17fff700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f18069f50 0x7f6f1814a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.467 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.359+0000 7f6f1c85c700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f180c2ed0 0x7f6f18164080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.467 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.361+0000 7f6f17fff700 1 -- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f180c2ed0 msgr2=0x7f6f18164080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.468 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.361+0000 7f6f17fff700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6f180c2ed0 0x7f6f18164080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.468 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.361+0000 7f6f17fff700 1 -- 172.21.15.151:0/4110219883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f180c1410 msgr2=0x7f6f18163b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.468 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.361+0000 7f6f17fff700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f180c1410 0x7f6f18163b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.468 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.361+0000 7f6f17fff700 1 -- 172.21.15.151:0/4110219883 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f00008320 con 0x7f6f18069f50 2022-03-15T05:50:11.469 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.361+0000 7f6f17fff700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f18069f50 0x7f6f1814a590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6f08007f90 tx=0x7f6f08009880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.469 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.361+0000 7f42ff7fe700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4300066b40 0x7f43000bc120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c440 tx=0x7f42f0007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.470 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.362+0000 7f6f14ff9700 1 -- 172.21.15.151:0/4110219883 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0800eca0 con 0x7f6f18069f50 2022-03-15T05:50:11.470 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.362+0000 7f6f14ff9700 1 -- 172.21.15.151:0/4110219883 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0800ee00 con 0x7f6f18069f50 2022-03-15T05:50:11.470 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.362+0000 7f6f14ff9700 1 -- 172.21.15.151:0/4110219883 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f08025640 con 0x7f6f18069f50 2022-03-15T05:50:11.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.362+0000 7f42e77fe700 1 -- 172.21.15.151:0/3253469873 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f00072e0 con 0x7f4300066b40 2022-03-15T05:50:11.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.362+0000 7f42e77fe700 1 -- 172.21.15.151:0/3253469873 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f0007440 con 0x7f4300066b40 2022-03-15T05:50:11.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.362+0000 7f42e77fe700 1 -- 172.21.15.151:0/3253469873 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0005780 con 0x7f4300066b40 2022-03-15T05:50:11.471 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.362+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43000bcef0 con 0x7f4300066b40 2022-03-15T05:50:11.472 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.362+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43000bd4b0 con 0x7f4300066b40 2022-03-15T05:50:11.472 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.364+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f43000704b0 con 0x7f4300066b40 2022-03-15T05:50:11.473 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.363+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f180b4170 con 0x7f6f18069f50 2022-03-15T05:50:11.473 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.363+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1814d990 con 0x7f6f18069f50 2022-03-15T05:50:11.474 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.365+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f1806b210 con 0x7f6f18069f50 2022-03-15T05:50:11.474 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.367+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 >> [v2:172.21.15.151:6819/35554,v1:172.21.15.151:6821/35554] conn(0x7f2ed006bd70 msgr2=0x7f2ed006e180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.474 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.367+0000 7f2ef712e700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.151:6819/35554,v1:172.21.15.151:6821/35554] conn(0x7f2ed006bd70 0x7f2ed006e180 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.475 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.367+0000 7f6f14ff9700 1 -- 172.21.15.151:0/4110219883 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f6f08012050 con 0x7f6f18069f50 2022-03-15T05:50:11.475 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.368+0000 7f6f14ff9700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6efc063490 0x7f6efc065940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.476 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.368+0000 7f6f14ff9700 1 -- 172.21.15.151:0/4110219883 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6f08091ef0 con 0x7f6f18069f50 2022-03-15T05:50:11.476 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.369+0000 7f6f14ff9700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:6808/41120,v1:172.21.15.164:6809/41120] conn(0x7f6efc06be60 0x7f6efc06e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.476 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.369+0000 7f6f14ff9700 1 -- 172.21.15.151:0/4110219883 --> [v2:172.21.15.164:6808/41120,v1:172.21.15.164:6809/41120] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6efc06e920 con 0x7f6efc06be60 2022-03-15T05:50:11.476 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.369+0000 7f6f14ff9700 1 -- 172.21.15.151:0/4110219883 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f08092220 con 0x7f6f18069f50 2022-03-15T05:50:11.477 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.367+0000 7f42e77fe700 1 -- 172.21.15.151:0/3253469873 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f42f0019030 con 0x7f4300066b40 2022-03-15T05:50:11.477 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.369+0000 7f6f1c85c700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:6808/41120,v1:172.21.15.164:6809/41120] conn(0x7f6efc06be60 0x7f6efc06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.478 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.369+0000 7f6f0f7fe700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6efc063490 0x7f6efc065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.478 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.369+0000 7f42e77fe700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f42e0063490 0x7f42e0065940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.478 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.369+0000 7f42e77fe700 1 -- 172.21.15.151:0/3253469873 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f42f007f0f0 con 0x7f4300066b40 2022-03-15T05:50:11.479 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.369+0000 7f42e77fe700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:6800/41119,v1:172.21.15.164:6801/41119] conn(0x7f42e006be60 0x7f42e006e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.479 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.369+0000 7f42e77fe700 1 -- 172.21.15.151:0/3253469873 --> [v2:172.21.15.164:6800/41119,v1:172.21.15.164:6801/41119] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42e006e920 con 0x7f42e006be60 2022-03-15T05:50:11.479 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.369+0000 7f42e77fe700 1 -- 172.21.15.151:0/3253469873 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42f007f3e0 con 0x7f4300066b40 2022-03-15T05:50:11.480 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.370+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2ed0063510 msgr2=0x7f2ed00659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.480 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.370+0000 7f2ef712e700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f2ed0063510 0x7f2ed00659c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ee8009880 tx=0x7f2ee8017000 comp rx=0 tx=0).stop 2022-03-15T05:50:11.480 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.370+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef0159400 msgr2=0x7f2ef0174d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.481 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.370+0000 7f2ef712e700 1 --2- 172.21.15.151:0/2812347001 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2ef0159400 0x7f2ef0174d30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2ee000c470 tx=0x7f2ee0007d70 comp rx=0 tx=0).stop 2022-03-15T05:50:11.481 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.370+0000 7f42feffd700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f42e0063490 0x7f42e0065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.481 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.370+0000 7f42fffff700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:6800/41119,v1:172.21.15.164:6801/41119] conn(0x7f42e006be60 0x7f42e006e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.371+0000 7f6f0f7fe700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6efc063490 0x7f6efc065940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6f18152570 tx=0x7f6f0001b000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.482 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.371+0000 7f42feffd700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f42e0063490 0x7f42e0065940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f43000c1540 tx=0x7f42f4006b90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.483 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.371+0000 7f6f1c85c700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:6808/41120,v1:172.21.15.164:6809/41120] conn(0x7f6efc06be60 0x7f6efc06e270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.371+0000 7f2ef56cb700 1 -- 172.21.15.151:0/2812347001 reap_dead start 2022-03-15T05:50:11.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.371+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 shutdown_connections 2022-03-15T05:50:11.484 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.371+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 >> 172.21.15.151:0/2812347001 conn(0x7f2ef006e5c0 msgr2=0x7f2ef00c4550 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.485 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.371+0000 7f42fffff700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:6800/41119,v1:172.21.15.164:6801/41119] conn(0x7f42e006be60 0x7f42e006e270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.485 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.371+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 shutdown_connections 2022-03-15T05:50:11.486 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.372+0000 7f2ef712e700 1 -- 172.21.15.151:0/2812347001 wait complete. 2022-03-15T05:50:11.486 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.372+0000 7f6f14ff9700 1 -- 172.21.15.151:0/4110219883 <== osd.7 v2:172.21.15.164:6808/41120 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f6efc06e920 con 0x7f6efc06be60 2022-03-15T05:50:11.487 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.372+0000 7f42e77fe700 1 -- 172.21.15.151:0/3253469873 <== osd.5 v2:172.21.15.164:6800/41119 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24062 (crc 0 0 0) 0x7f42e006e920 con 0x7f42e006be60 2022-03-15T05:50:11.487 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.374+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 --> [v2:172.21.15.151:6800/35552,v1:172.21.15.151:6801/35552] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe46804b760 con 0x7fe44806bee0 2022-03-15T05:50:11.487 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.375+0000 7fe44f7fe700 1 -- 172.21.15.151:0/1345671465 <== osd.0 v2:172.21.15.151:6800/35552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe46804b760 con 0x7fe44806bee0 2022-03-15T05:50:11.489 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.377+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 >> [v2:172.21.15.151:6800/35552,v1:172.21.15.151:6801/35552] conn(0x7fe44806bee0 msgr2=0x7fe44806e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.489 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.377+0000 7fe46dfac700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.151:6800/35552,v1:172.21.15.151:6801/35552] conn(0x7fe44806bee0 0x7fe44806e2f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.489 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.377+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe448063510 msgr2=0x7fe4480659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.489 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.377+0000 7fe46dfac700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fe448063510 0x7fe4480659c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe468150950 tx=0x7fe45c009060 comp rx=0 tx=0).stop 2022-03-15T05:50:11.490 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.377+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 msgr2=0x7fe468152160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.490 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.377+0000 7fe46dfac700 1 --2- 172.21.15.151:0/1345671465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe4540038e0 0x7fe468152160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe45800cc30 tx=0x7fe458015000 comp rx=0 tx=0).stop 2022-03-15T05:50:11.490 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.377+0000 7fe467fff700 1 -- 172.21.15.151:0/1345671465 reap_dead start 2022-03-15T05:50:11.491 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.383+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 --> [v2:172.21.15.164:6814/41129,v1:172.21.15.164:6817/41129] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb314002bb0 con 0x7fb31806bee0 2022-03-15T05:50:11.491 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.383+0000 7fb325ffb700 1 -- 172.21.15.151:0/1003075319 <== osd.6 v2:172.21.15.164:6814/41129 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb314002bb0 con 0x7fb31806bee0 2022-03-15T05:50:11.492 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.387+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 shutdown_connections 2022-03-15T05:50:11.492 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.387+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 >> 172.21.15.151:0/1345671465 conn(0x7fe4680c75c0 msgr2=0x7fe4680c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.492 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.387+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:6814/41129,v1:172.21.15.164:6817/41129] conn(0x7fb31806bee0 msgr2=0x7fb31806e2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.493 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.387+0000 7fb33fd0b700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:6814/41129,v1:172.21.15.164:6817/41129] conn(0x7fb31806bee0 0x7fb31806e2f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.493 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.387+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 shutdown_connections 2022-03-15T05:50:11.494 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.387+0000 7fe46dfac700 1 -- 172.21.15.151:0/1345671465 wait complete. 2022-03-15T05:50:11.494 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.389+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fb318063510 msgr2=0x7fb3180659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.495 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.389+0000 7fb33fd0b700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fb318063510 0x7fb3180659c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb328009310 tx=0x7fb328016000 comp rx=0 tx=0).stop 2022-03-15T05:50:11.495 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.389+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb338066b40 msgr2=0x7fb3380b7170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.495 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.389+0000 7fb33fd0b700 1 --2- 172.21.15.151:0/1003075319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb338066b40 0x7fb3380b7170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb33400c440 tx=0x7fb334007d00 comp rx=0 tx=0).stop 2022-03-15T05:50:11.495 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.389+0000 7fb33e2a8700 1 -- 172.21.15.151:0/1003075319 reap_dead start 2022-03-15T05:50:11.496 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.389+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 shutdown_connections 2022-03-15T05:50:11.496 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.389+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 >> 172.21.15.151:0/1003075319 conn(0x7fb3380c75c0 msgr2=0x7fb338066f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.496 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.390+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 --> [v2:172.21.15.164:6824/41130,v1:172.21.15.164:6825/41130] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f420404b760 con 0x7f41e806be60 2022-03-15T05:50:11.497 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.390+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 shutdown_connections 2022-03-15T05:50:11.497 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.390+0000 7fb33fd0b700 1 -- 172.21.15.151:0/1003075319 wait complete. 2022-03-15T05:50:11.498 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.391+0000 7f41fa7fc700 1 -- 172.21.15.151:0/3517672556 <== osd.4 v2:172.21.15.164:6824/41130 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f420404b760 con 0x7f41e806be60 2022-03-15T05:50:11.498 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.392+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 --> [v2:172.21.15.151:6816/35555,v1:172.21.15.151:6817/35555] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcad406ccd0 con 0x7fcabc06bf10 2022-03-15T05:50:11.499 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.392+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 --> [v2:172.21.15.151:6808/35553,v1:172.21.15.151:6809/35553] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9bc014afb0 con 0x7f9bc00c36a0 2022-03-15T05:50:11.500 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.392+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:6824/41130,v1:172.21.15.164:6825/41130] conn(0x7f41e806be60 msgr2=0x7f41e806e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.500 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.392+0000 7f4208f8b700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:6824/41130,v1:172.21.15.164:6825/41130] conn(0x7f41e806be60 0x7f41e806e270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.500 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.392+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f41e8063510 msgr2=0x7f41e80659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.500 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.392+0000 7f4208f8b700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f41e8063510 0x7f41e80659c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4204069540 tx=0x7f41ec016000 comp rx=0 tx=0).stop 2022-03-15T05:50:11.501 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.392+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4204150ff0 msgr2=0x7f4204168bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.501 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.392+0000 7f4208f8b700 1 --2- 172.21.15.151:0/3517672556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4204150ff0 0x7f4204168bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00c5b0 tx=0x7f41fc008040 comp rx=0 tx=0).stop 2022-03-15T05:50:11.501 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.393+0000 7f4202d9d700 1 -- 172.21.15.151:0/3517672556 reap_dead start 2022-03-15T05:50:11.501 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.393+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 shutdown_connections 2022-03-15T05:50:11.502 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.393+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 >> 172.21.15.151:0/3517672556 conn(0x7f42040c75c0 msgr2=0x7f42041401c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.502 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.393+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 shutdown_connections 2022-03-15T05:50:11.502 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.393+0000 7f4208f8b700 1 -- 172.21.15.151:0/3517672556 wait complete. 2022-03-15T05:50:11.503 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.394+0000 7fcac9ffb700 1 -- 172.21.15.151:0/1736398217 <== osd.2 v2:172.21.15.151:6816/35555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcad406ccd0 con 0x7fcabc06bf10 2022-03-15T05:50:11.503 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.394+0000 7f9bb57fa700 1 -- 172.21.15.151:0/812291287 <== osd.3 v2:172.21.15.151:6808/35553 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9bc014afb0 con 0x7f9bc00c36a0 2022-03-15T05:50:11.504 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.397+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 >> [v2:172.21.15.151:6808/35553,v1:172.21.15.151:6809/35553] conn(0x7f9bc00c36a0 msgr2=0x7f9bc014ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.504 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.397+0000 7f9bc77fe700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.151:6808/35553,v1:172.21.15.151:6809/35553] conn(0x7f9bc00c36a0 0x7f9bc014ff70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.505 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 >> [v2:172.21.15.151:6816/35555,v1:172.21.15.151:6817/35555] conn(0x7fcabc06bf10 msgr2=0x7fcabc06e320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.505 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7fcadc145700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.151:6816/35555,v1:172.21.15.151:6817/35555] conn(0x7fcabc06bf10 0x7fcabc06e320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.506 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ba00634e0 msgr2=0x7f9ba0065990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.506 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7f9bc77fe700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ba00634e0 0x7f9ba0065990 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9bb800f890 tx=0x7f9bb800c000 comp rx=0 tx=0).stop 2022-03-15T05:50:11.506 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bc0067c20 msgr2=0x7f9bc0153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.506 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7f9bc77fe700 1 --2- 172.21.15.151:0/812291287 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bc0067c20 0x7f9bc0153800 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9bb000d860 tx=0x7f9bb0008040 comp rx=0 tx=0).stop 2022-03-15T05:50:11.507 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7f9bc5d9b700 1 -- 172.21.15.151:0/812291287 reap_dead start 2022-03-15T05:50:11.507 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcabc063540 msgr2=0x7fcabc0659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.507 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7fcadc145700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fcabc063540 0x7fcabc0659f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcad4070520 tx=0x7fcac4009040 comp rx=0 tx=0).stop 2022-03-15T05:50:11.508 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcab8005040 msgr2=0x7fcad415f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.508 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.398+0000 7fcadc145700 1 --2- 172.21.15.151:0/1736398217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcab8005040 0x7fcad415f370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fcad0006fd0 tx=0x7fcad00090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.399+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 shutdown_connections 2022-03-15T05:50:11.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.399+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 >> 172.21.15.151:0/812291287 conn(0x7f9bc00c75c0 msgr2=0x7f9bc01458e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.399+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 shutdown_connections 2022-03-15T05:50:11.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.399+0000 7f9bc77fe700 1 -- 172.21.15.151:0/812291287 wait complete. 2022-03-15T05:50:11.510 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.404+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 --> [v2:172.21.15.164:6808/41120,v1:172.21.15.164:6809/41120] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f18154320 con 0x7f6efc06be60 2022-03-15T05:50:11.510 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.405+0000 7fcada6e2700 1 -- 172.21.15.151:0/1736398217 reap_dead start 2022-03-15T05:50:11.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.405+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 shutdown_connections 2022-03-15T05:50:11.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.405+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 >> 172.21.15.151:0/1736398217 conn(0x7fcad40c75c0 msgr2=0x7fcad415d110 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.405+0000 7f6f14ff9700 1 -- 172.21.15.151:0/4110219883 <== osd.7 v2:172.21.15.164:6808/41120 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f18154320 con 0x7f6efc06be60 2022-03-15T05:50:11.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.405+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 --> [v2:172.21.15.164:6800/41119,v1:172.21.15.164:6801/41119] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4300159660 con 0x7f42e006be60 2022-03-15T05:50:11.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.405+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:6808/41120,v1:172.21.15.164:6809/41120] conn(0x7f6efc06be60 msgr2=0x7f6efc06e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.405+0000 7f6f1d05d700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:6808/41120,v1:172.21.15.164:6809/41120] conn(0x7f6efc06be60 0x7f6efc06e270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.405+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 shutdown_connections 2022-03-15T05:50:11.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.406+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6efc063490 msgr2=0x7f6efc065940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.406+0000 7f6f1d05d700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f6efc063490 0x7f6efc065940 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6f18152570 tx=0x7f6f0001b000 comp rx=0 tx=0).stop 2022-03-15T05:50:11.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.406+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f18069f50 msgr2=0x7f6f1814a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.406+0000 7f6f1d05d700 1 --2- 172.21.15.151:0/4110219883 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6f18069f50 0x7f6f1814a590 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6f08007f90 tx=0x7f6f08009880 comp rx=0 tx=0).stop 2022-03-15T05:50:11.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.406+0000 7f6f1c85c700 1 -- 172.21.15.151:0/4110219883 reap_dead start 2022-03-15T05:50:11.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.406+0000 7f42e77fe700 1 -- 172.21.15.151:0/3253469873 <== osd.5 v2:172.21.15.164:6800/41119 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4300159660 con 0x7f42e006be60 2022-03-15T05:50:11.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.406+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 shutdown_connections 2022-03-15T05:50:11.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.406+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 >> 172.21.15.151:0/4110219883 conn(0x7f6f18068320 msgr2=0x7f6f18152cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.407+0000 7fcadc145700 1 -- 172.21.15.151:0/1736398217 wait complete. 2022-03-15T05:50:11.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.407+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 shutdown_connections 2022-03-15T05:50:11.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.408+0000 7f6f1d05d700 1 -- 172.21.15.151:0/4110219883 wait complete. 2022-03-15T05:50:11.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.408+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:6800/41119,v1:172.21.15.164:6801/41119] conn(0x7f42e006be60 msgr2=0x7f42e006e270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.408+0000 7f4305eb7700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:6800/41119,v1:172.21.15.164:6801/41119] conn(0x7f42e006be60 0x7f42e006e270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.409+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f42e0063490 msgr2=0x7f42e0065940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.409+0000 7f4305eb7700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f42e0063490 0x7f42e0065940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f43000c1540 tx=0x7f42f4006b90 comp rx=0 tx=0).stop 2022-03-15T05:50:11.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.409+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4300066b40 msgr2=0x7f43000bc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.409+0000 7f4305eb7700 1 --2- 172.21.15.151:0/3253469873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4300066b40 0x7f43000bc120 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c440 tx=0x7f42f0007d30 comp rx=0 tx=0).stop 2022-03-15T05:50:11.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.409+0000 7f42fffff700 1 -- 172.21.15.151:0/3253469873 reap_dead start 2022-03-15T05:50:11.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.409+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 shutdown_connections 2022-03-15T05:50:11.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.409+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 >> 172.21.15.151:0/3253469873 conn(0x7f43000c75c0 msgr2=0x7f4300066fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.410+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 shutdown_connections 2022-03-15T05:50:11.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.410+0000 7f4305eb7700 1 -- 172.21.15.151:0/3253469873 wait complete. 2022-03-15T05:50:11.522 INFO:teuthology.orchestra.run.smithi151.stdout:60129542152 2022-03-15T05:50:11.522 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-03-15T05:50:11.523 INFO:teuthology.orchestra.run.smithi151.stdout:60129542153 2022-03-15T05:50:11.524 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-03-15T05:50:11.525 INFO:teuthology.orchestra.run.smithi151.stdout:60129542153 2022-03-15T05:50:11.525 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-03-15T05:50:11.526 INFO:teuthology.orchestra.run.smithi151.stdout:60129542152 2022-03-15T05:50:11.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-03-15T05:50:11.528 INFO:teuthology.orchestra.run.smithi151.stdout:64424509448 2022-03-15T05:50:11.528 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-03-15T05:50:11.529 INFO:teuthology.orchestra.run.smithi151.stdout:64424509449 2022-03-15T05:50:11.530 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-03-15T05:50:11.531 INFO:teuthology.orchestra.run.smithi151.stdout:60129542153 2022-03-15T05:50:11.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-03-15T05:50:11.533 INFO:teuthology.orchestra.run.smithi151.stdout:60129542152 2022-03-15T05:50:11.534 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-03-15T05:50:11.951 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.944+0000 7f3a1dca3700 1 Processor -- start 2022-03-15T05:50:11.951 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.945+0000 7f3a1dca3700 1 -- start start 2022-03-15T05:50:11.951 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.947+0000 7f3a1dca3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18066b40 0x7f3a180c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.952 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.947+0000 7f3a1dca3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3a180c4090 0x7f3a1806d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.952 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.947+0000 7f3a1dca3700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a1806ced0 con 0x7f3a18067c20 2022-03-15T05:50:11.952 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.947+0000 7f3a1dca3700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a1806e510 con 0x7f3a180c4090 2022-03-15T05:50:11.952 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.947+0000 7f3a1dca3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a18159cb0 con 0x7f3a18066b40 2022-03-15T05:50:11.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.948+0000 7f3a177fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18066b40 0x7f3a180c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.948+0000 7f3a177fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18066b40 0x7f3a180c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60158/0 (socket says 172.21.15.151:60158) 2022-03-15T05:50:11.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.948+0000 7f3a177fe700 1 -- 172.21.15.151:0/378641793 learned_addr learned my addr 172.21.15.151:0/378641793 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.949+0000 7f3a16ffd700 1 --2- 172.21.15.151:0/378641793 >> v2:172.21.15.151:3300/0 conn(0x7f3a180c4090 0x7f3a1806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.949+0000 7f3a177fe700 1 -- 172.21.15.151:0/378641793 >> v2:172.21.15.151:3300/0 conn(0x7f3a180c4090 msgr2=0x7f3a1806d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.949+0000 7f3a177fe700 1 --2- 172.21.15.151:0/378641793 >> v2:172.21.15.151:3300/0 conn(0x7f3a180c4090 0x7f3a1806d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.949+0000 7f3a177fe700 1 -- 172.21.15.151:0/378641793 >> v1:172.21.15.151:6789/0 conn(0x7f3a18067c20 legacy=0x7f3a18066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.949+0000 7f3a177fe700 1 -- 172.21.15.151:0/378641793 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a1806d8a0 con 0x7f3a18066b40 2022-03-15T05:50:11.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.950+0000 7f3a177fe700 1 --2- 172.21.15.151:0/378641793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18066b40 0x7f3a180c14f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3a08006fd0 tx=0x7f3a080090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c68ad55070bebf server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.950+0000 7f3a167fc700 1 -- 172.21.15.151:0/378641793 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08011630 con 0x7f3a18066b40 2022-03-15T05:50:11.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.950+0000 7f3a167fc700 1 -- 172.21.15.151:0/378641793 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a08011790 con 0x7f3a18066b40 2022-03-15T05:50:11.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.950+0000 7f3a167fc700 1 -- 172.21.15.151:0/378641793 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a08011b50 con 0x7f3a18066b40 2022-03-15T05:50:11.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.951+0000 7f3a1dca3700 1 -- 172.21.15.151:0/378641793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18066b40 msgr2=0x7f3a180c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.951+0000 7f3a1dca3700 1 --2- 172.21.15.151:0/378641793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18066b40 0x7f3a180c14f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3a08006fd0 tx=0x7f3a080090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.952+0000 7f84d9d11700 1 Processor -- start 2022-03-15T05:50:11.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.952+0000 7f84d9d11700 1 -- start start 2022-03-15T05:50:11.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.954+0000 7f84d9d11700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f84d406d320 0x7f84d4150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.954+0000 7f84d9d11700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 0x7f84d415b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.954+0000 7f84d9d11700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d40c14f0 con 0x7f84d4151530 2022-03-15T05:50:11.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.954+0000 7f84d9d11700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d406cfb0 con 0x7f84d406d320 2022-03-15T05:50:11.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.954+0000 7f84d9d11700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d41508c0 con 0x7f84d414ae50 2022-03-15T05:50:11.961 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.953+0000 7f3a1dca3700 1 -- 172.21.15.151:0/378641793 shutdown_connections 2022-03-15T05:50:11.961 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.953+0000 7f3a1dca3700 1 --2- 172.21.15.151:0/378641793 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18066b40 0x7f3a180c14f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.953+0000 7f3a1dca3700 1 --2- 172.21.15.151:0/378641793 >> v2:172.21.15.151:3300/0 conn(0x7f3a180c4090 0x7f3a1806d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.953+0000 7f3a1dca3700 1 -- 172.21.15.151:0/378641793 >> 172.21.15.151:0/378641793 conn(0x7f3a180c75c0 msgr2=0x7f3a180c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.962 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.953+0000 7f3a1dca3700 1 -- 172.21.15.151:0/378641793 shutdown_connections 2022-03-15T05:50:11.963 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.953+0000 7f3a1dca3700 1 -- 172.21.15.151:0/378641793 wait complete. 2022-03-15T05:50:11.964 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.956+0000 7f84d2ffd700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f84d4151530 0x7f84d414a740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53202/0 (socket says 172.21.15.151:53202) 2022-03-15T05:50:11.964 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.956+0000 7f84d2ffd700 1 -- 172.21.15.151:0/3920998460 learned_addr learned my addr 172.21.15.151:0/3920998460 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:11.965 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.956+0000 7f3a1dca3700 1 Processor -- start 2022-03-15T05:50:11.966 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.957+0000 7f84d3fff700 1 --2- 172.21.15.151:0/3920998460 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 0x7f84d415b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.967 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.956+0000 7f3a1dca3700 1 -- start start 2022-03-15T05:50:11.967 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.957+0000 7efffec3c700 1 Processor -- start 2022-03-15T05:50:11.968 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f84d3fff700 1 -- 172.21.15.151:0/3920998460 >> v2:172.21.15.164:3300/0 conn(0x7f84d406d320 msgr2=0x7f84d4150ff0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-03-15T05:50:11.969 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f84d3fff700 1 --2- 172.21.15.151:0/3920998460 >> v2:172.21.15.164:3300/0 conn(0x7f84d406d320 0x7f84d4150ff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.969 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f84d3fff700 1 -- 172.21.15.151:0/3920998460 >> v1:172.21.15.151:6789/0 conn(0x7f84d4151530 legacy=0x7f84d414a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.970 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f84d3fff700 1 -- 172.21.15.151:0/3920998460 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d40c4390 con 0x7f84d414ae50 2022-03-15T05:50:11.970 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f3a1dca3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a18066b40 0x7f3a18146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.971 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f3a1dca3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18067c20 0x7f3a18069d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.971 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f3a1dca3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a180c4090 0x7f3a1806a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.972 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f3a1dca3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1813adb0 con 0x7f3a18066b40 2022-03-15T05:50:11.972 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f3a1dca3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a18146e40 con 0x7f3a180c4090 2022-03-15T05:50:11.973 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f3a1dca3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a1813a2b0 con 0x7f3a18067c20 2022-03-15T05:50:11.973 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f3a16ffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18067c20 0x7f3a18069d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.973 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f3a16ffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18067c20 0x7f3a18069d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60162/0 (socket says 172.21.15.151:60162) 2022-03-15T05:50:11.974 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7f3a16ffd700 1 -- 172.21.15.151:0/3092842156 learned_addr learned my addr 172.21.15.151:0/3092842156 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.975 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.959+0000 7f84d3fff700 1 --2- 172.21.15.151:0/3920998460 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 0x7f84d415b150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009e60 tx=0x7f84cc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e81e61dca4e3f9e server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.976 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.958+0000 7efffec3c700 1 -- start start 2022-03-15T05:50:11.976 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.959+0000 7f3a17fff700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a180c4090 0x7f3a1806a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.977 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7f3a16ffd700 1 -- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a180c4090 msgr2=0x7f3a1806a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.977 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7f3a16ffd700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a180c4090 0x7f3a1806a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.978 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7f3a16ffd700 1 -- 172.21.15.151:0/3092842156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a18066b40 msgr2=0x7f3a18146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.978 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7f3a16ffd700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a18066b40 0x7f3a18146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.979 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7f3a16ffd700 1 -- 172.21.15.151:0/3092842156 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a08009370 con 0x7f3a18067c20 2022-03-15T05:50:11.979 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7efffec3c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efff80c3d00 0x7efff8151300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.980 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7efffec3c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c08d0 0x7efff8151df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:11.980 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7efffec3c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efff806db00 con 0x7efff8152330 2022-03-15T05:50:11.981 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7efffec3c700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efff8151840 con 0x7efff80c3d00 2022-03-15T05:50:11.981 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7efffec3c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff8152790 con 0x7efff80c08d0 2022-03-15T05:50:11.982 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7f84d27fc700 1 -- 172.21.15.151:0/3920998460 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc00e070 con 0x7f84d414ae50 2022-03-15T05:50:11.983 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7f84d27fc700 1 -- 172.21.15.151:0/3920998460 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc00bc30 con 0x7f84d414ae50 2022-03-15T05:50:11.983 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.960+0000 7f84d27fc700 1 -- 172.21.15.151:0/3920998460 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc012430 con 0x7f84d414ae50 2022-03-15T05:50:11.984 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.961+0000 7f3a16ffd700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18067c20 0x7f3a18069d50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000e1c0 tx=0x7f3a10009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.985 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.961+0000 7efff7fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c08d0 0x7efff8151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:11.985 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.961+0000 7efff7fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c08d0 0x7efff8151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60166/0 (socket says 172.21.15.151:60166) 2022-03-15T05:50:11.986 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.961+0000 7efff7fff700 1 -- 172.21.15.151:0/3571205873 learned_addr learned my addr 172.21.15.151:0/3571205873 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:11.987 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.961+0000 7f84d9d11700 1 -- 172.21.15.151:0/3920998460 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 msgr2=0x7f84d415b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:11.987 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.961+0000 7f84d9d11700 1 --2- 172.21.15.151:0/3920998460 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 0x7f84d415b150 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f84cc009e60 tx=0x7f84cc009780 comp rx=0 tx=0).stop 2022-03-15T05:50:11.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.962+0000 7f84d9d11700 1 -- 172.21.15.151:0/3920998460 shutdown_connections 2022-03-15T05:50:11.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.962+0000 7f84d9d11700 1 --2- 172.21.15.151:0/3920998460 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 0x7f84d415b150 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.989 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.962+0000 7f84d9d11700 1 --2- 172.21.15.151:0/3920998460 >> v2:172.21.15.164:3300/0 conn(0x7f84d406d320 0x7f84d4150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.989 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.962+0000 7f84d9d11700 1 -- 172.21.15.151:0/3920998460 >> 172.21.15.151:0/3920998460 conn(0x7f84d40c75c0 msgr2=0x7f84d40c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:11.990 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.962+0000 7efff7fff700 1 -- 172.21.15.151:0/3571205873 >> v2:172.21.15.151:3300/0 conn(0x7efff80c3d00 msgr2=0x7efff8151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.991 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.962+0000 7efff7fff700 1 --2- 172.21.15.151:0/3571205873 >> v2:172.21.15.151:3300/0 conn(0x7efff80c3d00 0x7efff8151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:11.991 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.962+0000 7efff7fff700 1 -- 172.21.15.151:0/3571205873 >> v1:172.21.15.151:6789/0 conn(0x7efff8152330 legacy=0x7efff8153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:11.991 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.962+0000 7efff7fff700 1 -- 172.21.15.151:0/3571205873 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff806cc10 con 0x7efff80c08d0 2022-03-15T05:50:11.992 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.961+0000 7f39ff7fe700 1 -- 172.21.15.151:0/3092842156 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a1000ee00 con 0x7f3a18067c20 2022-03-15T05:50:11.993 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.962+0000 7f39ff7fe700 1 -- 172.21.15.151:0/3092842156 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a10003860 con 0x7f3a18067c20 2022-03-15T05:50:11.993 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.962+0000 7f39ff7fe700 1 -- 172.21.15.151:0/3092842156 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a10003c20 con 0x7f3a18067c20 2022-03-15T05:50:11.994 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.963+0000 7f3a1dca3700 1 -- 172.21.15.151:0/3092842156 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a180b69d0 con 0x7f3a18067c20 2022-03-15T05:50:11.994 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.963+0000 7f84d9d11700 1 -- 172.21.15.151:0/3920998460 shutdown_connections 2022-03-15T05:50:11.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.963+0000 7efff7fff700 1 --2- 172.21.15.151:0/3571205873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c08d0 0x7efff8151df0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7effe8006fd0 tx=0x7effe80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86a619e26b44b8a2 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:11.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.963+0000 7f84d9d11700 1 -- 172.21.15.151:0/3920998460 wait complete. 2022-03-15T05:50:11.997 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.963+0000 7f3a1dca3700 1 -- 172.21.15.151:0/3092842156 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a1813a780 con 0x7f3a18067c20 2022-03-15T05:50:11.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.964+0000 7f3a1dca3700 1 -- 172.21.15.151:0/3092842156 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a180704b0 con 0x7f3a18067c20 2022-03-15T05:50:11.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.964+0000 7fbb98e19700 1 Processor -- start 2022-03-15T05:50:11.999 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.964+0000 7fbb98e19700 1 -- start start 2022-03-15T05:50:12.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.965+0000 7f84d9d11700 1 Processor -- start 2022-03-15T05:50:12.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.966+0000 7f84d9d11700 1 -- start start 2022-03-15T05:50:12.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7f84d9d11700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d406d320 0x7f84d40c64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7f84d9d11700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 0x7f84d414fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7f84d9d11700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d4151530 0x7f84d40bff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7f84d9d11700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40c6a10 con 0x7f84d406d320 2022-03-15T05:50:12.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7f84d9d11700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40be020 con 0x7f84d4151530 2022-03-15T05:50:12.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7f84d9d11700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4168500 con 0x7f84d414ae50 2022-03-15T05:50:12.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f84d3fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d4151530 0x7f84d40bff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f84d3fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d4151530 0x7f84d40bff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57274/0 (socket says 172.21.15.151:57274) 2022-03-15T05:50:12.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f84d3fff700 1 -- 172.21.15.151:0/1347041853 learned_addr learned my addr 172.21.15.151:0/1347041853 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:12.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f84d2ffd700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 0x7f84d414fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f84d37fe700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d406d320 0x7f84d40c64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f84d3fff700 1 -- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 msgr2=0x7f84d414fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f84d3fff700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 0x7f84d414fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f84d3fff700 1 -- 172.21.15.151:0/1347041853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d406d320 msgr2=0x7f84d40c64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f84d3fff700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d406d320 0x7f84d40c64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f84d3fff700 1 -- 172.21.15.151:0/1347041853 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84cc009a20 con 0x7f84d4151530 2022-03-15T05:50:12.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.969+0000 7f84d3fff700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d4151530 0x7f84d40bff20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84cc013000 tx=0x7f84cc019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.969+0000 7f84bb7fe700 1 -- 172.21.15.151:0/1347041853 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc0129d0 con 0x7f84d4151530 2022-03-15T05:50:12.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.969+0000 7f84bb7fe700 1 -- 172.21.15.151:0/1347041853 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84cc012b30 con 0x7f84d4151530 2022-03-15T05:50:12.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.969+0000 7f84bb7fe700 1 -- 172.21.15.151:0/1347041853 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84cc004040 con 0x7f84d4151530 2022-03-15T05:50:12.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7f39ff7fe700 1 -- 172.21.15.151:0/3092842156 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f3a1001c030 con 0x7f3a18067c20 2022-03-15T05:50:12.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f39ff7fe700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f39f8063510 0x7f39f80659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7f39ff7fe700 1 -- 172.21.15.151:0/3092842156 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3a10080080 con 0x7f3a18067c20 2022-03-15T05:50:12.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7f631ab18700 1 Processor -- start 2022-03-15T05:50:12.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7f631ab18700 1 -- start start 2022-03-15T05:50:12.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.965+0000 7efff77fe700 1 -- 172.21.15.151:0/3571205873 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8011630 con 0x7efff80c08d0 2022-03-15T05:50:12.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.965+0000 7efff77fe700 1 -- 172.21.15.151:0/3571205873 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effe80117b0 con 0x7efff80c08d0 2022-03-15T05:50:12.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.965+0000 7efff77fe700 1 -- 172.21.15.151:0/3571205873 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effe8011b70 con 0x7efff80c08d0 2022-03-15T05:50:12.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.966+0000 7efffec3c700 1 -- 172.21.15.151:0/3571205873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c08d0 msgr2=0x7efff8151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.966+0000 7efffec3c700 1 --2- 172.21.15.151:0/3571205873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c08d0 0x7efff8151df0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7effe8006fd0 tx=0x7effe80090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7f631ab18700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f6314151300 0x7f6314151df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7f631ab18700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6314152330 0x7f6314155120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7f631ab18700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f631406db00 con 0x7f63140c3d00 2022-03-15T05:50:12.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7f631ab18700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63140c0e20 con 0x7f6314152330 2022-03-15T05:50:12.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7f631ab18700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f631406cef0 con 0x7f6314151300 2022-03-15T05:50:12.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7f63188b4700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f63140c3d00 0x7f63140c0710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33666/0 (socket says 172.21.15.151:33666) 2022-03-15T05:50:12.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7f63188b4700 1 -- 172.21.15.151:0/289053481 learned_addr learned my addr 172.21.15.151:0/289053481 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:12.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7f39ff7fe700 1 -- 172.21.15.151:0/3092842156 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f3a1004f1d0 con 0x7f3a18067c20 2022-03-15T05:50:12.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7fbb98e19700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.967+0000 7fbb98e19700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbb94067c20 0x7fbb940be4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7fbb98e19700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb940c2ab0 con 0x7fbb94066980 2022-03-15T05:50:12.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7fbb98e19700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb940c27d0 con 0x7fbb94067c20 2022-03-15T05:50:12.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7fbb98e19700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940c33d0 con 0x7fbb9406edc0 2022-03-15T05:50:12.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7fbb92d9d700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fbb94066980 0x7fbb94066e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33664/0 (socket says 172.21.15.151:33664) 2022-03-15T05:50:12.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.968+0000 7fbb92d9d700 1 -- 172.21.15.151:0/2300296725 learned_addr learned my addr 172.21.15.151:0/2300296725 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:12.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.969+0000 7fbb9259c700 1 --2- 172.21.15.151:0/2300296725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.969+0000 7fbb91d9b700 1 --2- 172.21.15.151:0/2300296725 >> v2:172.21.15.164:3300/0 conn(0x7fbb94067c20 0x7fbb940be4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.969+0000 7fbb9159a700 1 -- 172.21.15.151:0/2300296725 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174735761 0 0) 0x7fbb940c2ab0 con 0x7fbb94066980 2022-03-15T05:50:12.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.969+0000 7fbb9159a700 1 -- 172.21.15.151:0/2300296725 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb780033f0 con 0x7fbb94066980 2022-03-15T05:50:12.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7fbb9259c700 1 -- 172.21.15.151:0/2300296725 >> v2:172.21.15.164:3300/0 conn(0x7fbb94067c20 msgr2=0x7fbb940be4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:12.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7fbb9259c700 1 --2- 172.21.15.151:0/2300296725 >> v2:172.21.15.164:3300/0 conn(0x7fbb94067c20 0x7fbb940be4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.024 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7fbb9259c700 1 -- 172.21.15.151:0/2300296725 >> v1:172.21.15.164:6789/0 conn(0x7fbb94066980 legacy=0x7fbb94066e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.024 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7f84d9d11700 1 -- 172.21.15.151:0/1347041853 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d4168770 con 0x7f84d4151530 2022-03-15T05:50:12.025 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7fbb9259c700 1 -- 172.21.15.151:0/2300296725 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940c1eb0 con 0x7fbb9406edc0 2022-03-15T05:50:12.025 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.970+0000 7f84d9d11700 1 -- 172.21.15.151:0/1347041853 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d40c6010 con 0x7f84d4151530 2022-03-15T05:50:12.026 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7fbb9259c700 1 --2- 172.21.15.151:0/2300296725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bdf90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009760 tx=0x7fbb84009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4e42c39ac998f92 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.026 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7f6313fff700 1 --2- 172.21.15.151:0/289053481 >> v2:172.21.15.164:3300/0 conn(0x7f6314151300 0x7f6314151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.027 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7f63137fe700 1 -- 172.21.15.151:0/289053481 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510784699 0 0) 0x7f631406db00 con 0x7f63140c3d00 2022-03-15T05:50:12.027 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7f63137fe700 1 -- 172.21.15.151:0/289053481 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f62f80033f0 con 0x7f63140c3d00 2022-03-15T05:50:12.027 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7efffec3c700 1 -- 172.21.15.151:0/3571205873 shutdown_connections 2022-03-15T05:50:12.028 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7efffec3c700 1 --2- 172.21.15.151:0/3571205873 >> v2:172.21.15.151:3300/0 conn(0x7efff80c3d00 0x7efff8151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.028 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7efffec3c700 1 --2- 172.21.15.151:0/3571205873 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c08d0 0x7efff8151df0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.028 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7efffec3c700 1 -- 172.21.15.151:0/3571205873 >> 172.21.15.151:0/3571205873 conn(0x7efff80c75c0 msgr2=0x7efff80c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.029 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7f84d9d11700 1 -- 172.21.15.151:0/1347041853 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d40c61d0 con 0x7f84d4151530 2022-03-15T05:50:12.029 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.972+0000 7fbb9159a700 1 -- 172.21.15.151:0/2300296725 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c0017f0 con 0x7fbb9406edc0 2022-03-15T05:50:12.029 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.972+0000 7fbb9159a700 1 -- 172.21.15.151:0/2300296725 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb84004030 con 0x7fbb9406edc0 2022-03-15T05:50:12.030 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.972+0000 7fbb9159a700 1 -- 172.21.15.151:0/2300296725 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840043d0 con 0x7fbb9406edc0 2022-03-15T05:50:12.030 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.972+0000 7f6313fff700 1 -- 172.21.15.151:0/289053481 >> v2:172.21.15.151:3300/0 conn(0x7f6314152330 msgr2=0x7f6314155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:12.030 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.972+0000 7f6313fff700 1 --2- 172.21.15.151:0/289053481 >> v2:172.21.15.151:3300/0 conn(0x7f6314152330 0x7f6314155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.031 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.972+0000 7f6313fff700 1 -- 172.21.15.151:0/289053481 >> v1:172.21.15.164:6789/0 conn(0x7f63140c3d00 legacy=0x7f63140c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.031 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.972+0000 7f6313fff700 1 -- 172.21.15.151:0/289053481 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f631406d1d0 con 0x7f6314151300 2022-03-15T05:50:12.031 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.972+0000 7f6313fff700 1 --2- 172.21.15.151:0/289053481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6314151300 0x7f6314151df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f631406ba30 tx=0x7f6300009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4224f05f05af62e8 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.031 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.972+0000 7efffec3c700 1 -- 172.21.15.151:0/3571205873 shutdown_connections 2022-03-15T05:50:12.032 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7f791aaca700 1 Processor -- start 2022-03-15T05:50:12.033 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.971+0000 7f791aaca700 1 -- start start 2022-03-15T05:50:12.033 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7fbb98e19700 1 -- 172.21.15.151:0/2300296725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 msgr2=0x7fbb940bdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.033 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7fbb98e19700 1 --2- 172.21.15.151:0/2300296725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bdf90 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009760 tx=0x7fbb84009060 comp rx=0 tx=0).stop 2022-03-15T05:50:12.034 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.972+0000 7f3a177fe700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f39f8063510 0x7f39f80659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.034 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7ffa9654d700 1 Processor -- start 2022-03-15T05:50:12.035 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7fbb98e19700 1 -- 172.21.15.151:0/2300296725 shutdown_connections 2022-03-15T05:50:12.035 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7fbb98e19700 1 --2- 172.21.15.151:0/2300296725 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bdf90 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7fbb98e19700 1 --2- 172.21.15.151:0/2300296725 >> v2:172.21.15.164:3300/0 conn(0x7fbb94067c20 0x7fbb940be4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7fbb98e19700 1 -- 172.21.15.151:0/2300296725 >> 172.21.15.151:0/2300296725 conn(0x7fbb940c75c0 msgr2=0x7fbb940c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7f46eab61700 1 Processor -- start 2022-03-15T05:50:12.037 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7efffec3c700 1 -- 172.21.15.151:0/3571205873 wait complete. 2022-03-15T05:50:12.037 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7ffa9654d700 1 -- start start 2022-03-15T05:50:12.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.974+0000 7f84bb7fe700 1 -- 172.21.15.151:0/1347041853 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f84cc004470 con 0x7f84d4151530 2022-03-15T05:50:12.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.975+0000 7f84bb7fe700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84b4063470 0x7f84b4065920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7f84bb7fe700 1 -- 172.21.15.151:0/1347041853 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f84cc082b30 con 0x7f84d4151530 2022-03-15T05:50:12.039 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7f3a177fe700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f39f8063510 0x7f39f80659c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a08006fd0 tx=0x7f3a08017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.039 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7efffec3c700 1 Processor -- start 2022-03-15T05:50:12.039 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.977+0000 7efffec3c700 1 -- start start 2022-03-15T05:50:12.040 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.974+0000 7f791aaca700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.040 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.974+0000 7f791aaca700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7914159780 con 0x7f79140c4090 2022-03-15T05:50:12.040 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.974+0000 7f791aaca700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79141599d0 con 0x7f7914067c20 2022-03-15T05:50:12.041 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.974+0000 7f791aaca700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7914159cb0 con 0x7f7914066b40 2022-03-15T05:50:12.041 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.975+0000 7f7918866700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.041 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.975+0000 7f7918866700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60172/0 (socket says 172.21.15.151:60172) 2022-03-15T05:50:12.041 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7f7918866700 1 -- 172.21.15.151:0/587334002 learned_addr learned my addr 172.21.15.151:0/587334002 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:12.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7f7918866700 1 -- 172.21.15.151:0/587334002 >> v1:172.21.15.164:6789/0 conn(0x7f7914067c20 legacy=0x7f7914155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7f7918866700 1 -- 172.21.15.151:0/587334002 >> v1:172.21.15.151:6789/0 conn(0x7f79140c4090 legacy=0x7f7914066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:12.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7f7918866700 1 -- 172.21.15.151:0/587334002 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f791406c880 con 0x7f7914066b40 2022-03-15T05:50:12.043 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7fbb98e19700 1 -- 172.21.15.151:0/2300296725 shutdown_connections 2022-03-15T05:50:12.043 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.974+0000 7fbb98e19700 1 -- 172.21.15.151:0/2300296725 wait complete. 2022-03-15T05:50:12.044 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7ffa9654d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ffa900c4090 0x7ffa900c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7ffa9654d700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9006ced0 con 0x7ffa90067c20 2022-03-15T05:50:12.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7ffa9654d700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa90159740 con 0x7ffa90066b40 2022-03-15T05:50:12.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7ffa9654d700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa9006e510 con 0x7ffa900c4090 2022-03-15T05:50:12.046 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7ffa8ffff700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ffa90066b40 0x7ffa90066f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33670/0 (socket says 172.21.15.151:33670) 2022-03-15T05:50:12.046 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7ffa8ffff700 1 -- 172.21.15.151:0/2751754927 learned_addr learned my addr 172.21.15.151:0/2751754927 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:12.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.973+0000 7f46eab61700 1 -- start start 2022-03-15T05:50:12.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.975+0000 7f46eab61700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e40c08d0 0x7f46e4151300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.975+0000 7f46eab61700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f46e4151df0 0x7f46e4152220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.975+0000 7f46eab61700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e406db00 con 0x7f46e4153e10 2022-03-15T05:50:12.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.975+0000 7f46eab61700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e4151840 con 0x7f46e4151df0 2022-03-15T05:50:12.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.975+0000 7f46eab61700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e4152760 con 0x7f46e40c08d0 2022-03-15T05:50:12.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7f46e90fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f46e4153e10 0x7f46e4154290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33672/0 (socket says 172.21.15.151:33672) 2022-03-15T05:50:12.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7f46e90fe700 1 -- 172.21.15.151:0/1186151317 learned_addr learned my addr 172.21.15.151:0/1186151317 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:12.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.977+0000 7f84d37fe700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84b4063470 0x7f84b4065920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.050 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.977+0000 7f46e88fd700 1 --2- 172.21.15.151:0/1186151317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e40c08d0 0x7f46e4151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.050 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.977+0000 7f46e3fff700 1 --2- 172.21.15.151:0/1186151317 >> v2:172.21.15.151:3300/0 conn(0x7f46e4151df0 0x7f46e4152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.051 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7f63137fe700 1 -- 172.21.15.151:0/289053481 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300011630 con 0x7f6314151300 2022-03-15T05:50:12.051 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7f63137fe700 1 -- 172.21.15.151:0/289053481 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6300011790 con 0x7f6314151300 2022-03-15T05:50:12.051 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7f63137fe700 1 -- 172.21.15.151:0/289053481 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6300011b30 con 0x7f6314151300 2022-03-15T05:50:12.052 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7f7918866700 1 --2- 172.21.15.151:0/587334002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c14f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7900009830 tx=0x7f79000090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=853c6b32ee5469f4 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.052 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7f84bb7fe700 1 -- 172.21.15.151:0/1347041853 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f84cc051af0 con 0x7f84d4151530 2022-03-15T05:50:12.052 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2045076239 0 0) 0x7ffa90159740 con 0x7ffa90066b40 2022-03-15T05:50:12.053 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa7c0033f0 con 0x7ffa90066b40 2022-03-15T05:50:12.053 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7f46e88fd700 1 -- 172.21.15.151:0/1186151317 >> v2:172.21.15.151:3300/0 conn(0x7f46e4151df0 msgr2=0x7f46e4152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:12.053 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7f46e88fd700 1 --2- 172.21.15.151:0/1186151317 >> v2:172.21.15.151:3300/0 conn(0x7f46e4151df0 0x7f46e4152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.054 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7f46e88fd700 1 -- 172.21.15.151:0/1186151317 >> v1:172.21.15.164:6789/0 conn(0x7f46e4153e10 legacy=0x7f46e4154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.054 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7f46e88fd700 1 -- 172.21.15.151:0/1186151317 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e406cc10 con 0x7f46e40c08d0 2022-03-15T05:50:12.054 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7f631ab18700 1 -- 172.21.15.151:0/289053481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6314151300 msgr2=0x7f6314151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.055 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7f631ab18700 1 --2- 172.21.15.151:0/289053481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6314151300 0x7f6314151df0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f631406ba30 tx=0x7f6300009060 comp rx=0 tx=0).stop 2022-03-15T05:50:12.056 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7fbb98e19700 1 Processor -- start 2022-03-15T05:50:12.056 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.976+0000 7fbb98e19700 1 -- start start 2022-03-15T05:50:12.056 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7fbb98e19700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb94066980 0x7fbb940bf440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.056 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7fbb98e19700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb94067c20 0x7fbb941615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.057 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7fbb98e19700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.057 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7fbb98e19700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940bfed0 con 0x7fbb94067c20 2022-03-15T05:50:12.057 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7fbb98e19700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94171de0 con 0x7fbb94066980 2022-03-15T05:50:12.057 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7fbb98e19700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940c0ad0 con 0x7fbb9406edc0 2022-03-15T05:50:12.058 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7fbb92d9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.058 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7fbb92d9d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60178/0 (socket says 172.21.15.151:60178) 2022-03-15T05:50:12.058 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.978+0000 7fbb92d9d700 1 -- 172.21.15.151:0/3803169452 learned_addr learned my addr 172.21.15.151:0/3803169452 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:12.059 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7efffec3c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efff80c08d0 0x7efff814c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.059 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7efffec3c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c3d00 0x7efff80bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.059 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7efffec3c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efff8152330 0x7efff81443e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.059 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7efffec3c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff81485d0 con 0x7efff8152330 2022-03-15T05:50:12.059 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7efffec3c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efff8145c80 con 0x7efff80c08d0 2022-03-15T05:50:12.060 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7efffec3c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efff814e3a0 con 0x7efff80c3d00 2022-03-15T05:50:12.060 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7efff7fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c3d00 0x7efff80bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.060 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7efff7fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c3d00 0x7efff80bf940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60180/0 (socket says 172.21.15.151:60180) 2022-03-15T05:50:12.060 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7efff7fff700 1 -- 172.21.15.151:0/580977276 learned_addr learned my addr 172.21.15.151:0/580977276 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:12.061 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7efffc9d8700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efff80c08d0 0x7efff814c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.061 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7efffd1d9700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efff8152330 0x7efff81443e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.061 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7efffc9d8700 1 -- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c3d00 msgr2=0x7efff80bf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.061 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7efffc9d8700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c3d00 0x7efff80bf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.062 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7efffc9d8700 1 -- 172.21.15.151:0/580977276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efff8152330 msgr2=0x7efff81443e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.062 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7efffc9d8700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efff8152330 0x7efff81443e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.062 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7efffc9d8700 1 -- 172.21.15.151:0/580977276 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effe8009370 con 0x7efff80c08d0 2022-03-15T05:50:12.062 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7f79137fe700 1 -- 172.21.15.151:0/587334002 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900011630 con 0x7f7914066b40 2022-03-15T05:50:12.063 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7f79137fe700 1 -- 172.21.15.151:0/587334002 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79000117b0 con 0x7f7914066b40 2022-03-15T05:50:12.063 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7f79137fe700 1 -- 172.21.15.151:0/587334002 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900011b70 con 0x7f7914066b40 2022-03-15T05:50:12.063 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7f791aaca700 1 -- 172.21.15.151:0/587334002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 msgr2=0x7f79140c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.063 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7f791aaca700 1 --2- 172.21.15.151:0/587334002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c14f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7900009830 tx=0x7f79000090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.064 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7f791aaca700 1 -- 172.21.15.151:0/587334002 shutdown_connections 2022-03-15T05:50:12.064 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7f791aaca700 1 --2- 172.21.15.151:0/587334002 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c14f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.064 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7f791aaca700 1 -- 172.21.15.151:0/587334002 >> 172.21.15.151:0/587334002 conn(0x7f79140c75c0 msgr2=0x7f79140c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.065 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7fbb92d9d700 1 -- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb94066980 msgr2=0x7fbb940bf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.065 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7fbb92d9d700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb94066980 0x7fbb940bf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.065 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7fbb92d9d700 1 -- 172.21.15.151:0/3803169452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb94067c20 msgr2=0x7fbb941615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.065 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7fbb92d9d700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb94067c20 0x7fbb941615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.066 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7fbb92d9d700 1 -- 172.21.15.151:0/3803169452 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb840092a0 con 0x7fbb9406edc0 2022-03-15T05:50:12.066 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7fbb92d9d700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bc8a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00dcc0 tx=0x7fbb8c00d180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.066 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 <== mon.1 v1:172.21.15.164:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 361003843 0 0) 0x7ffa7c0033f0 con 0x7ffa90066b40 2022-03-15T05:50:12.067 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 >> v2:172.21.15.151:3300/0 conn(0x7ffa900c4090 msgr2=0x7ffa900c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:12.067 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7ffa8effd700 1 --2- 172.21.15.151:0/2751754927 >> v2:172.21.15.151:3300/0 conn(0x7ffa900c4090 0x7ffa900c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.067 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 >> v1:172.21.15.151:6789/0 conn(0x7ffa90067c20 legacy=0x7ffa90155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.067 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 --> v1:172.21.15.164:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa901599d0 con 0x7ffa90066b40 2022-03-15T05:50:12.067 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 <== mon.1 v1:172.21.15.164:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1345219590 0 0) 0x7ffa84001470 con 0x7ffa90066b40 2022-03-15T05:50:12.068 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 >> v1:172.21.15.164:6789/0 conn(0x7ffa90066b40 legacy=0x7ffa90066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.068 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7ffa8effd700 1 --2- 172.21.15.151:0/2751754927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa7c0038e0 0x7ffa7c003cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.068 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.979+0000 7ffa8effd700 1 --2- 172.21.15.151:0/2751754927 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa7c004690 0x7ffa7c004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.068 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7ffa8effd700 1 --2- 172.21.15.151:0/2751754927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c005290 0x7ffa7c00b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.069 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9006e510 con 0x7ffa7c0038e0 2022-03-15T05:50:12.069 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c00c220 con 0x7ffa7c005290 2022-03-15T05:50:12.069 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c00c3e0 con 0x7ffa7c004690 2022-03-15T05:50:12.070 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7f46e88fd700 1 --2- 172.21.15.151:0/1186151317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e40c08d0 0x7f46e4151300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009e60 tx=0x7f46dc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d66fbdd5aa74ce4f server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.070 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7f791aaca700 1 -- 172.21.15.151:0/587334002 shutdown_connections 2022-03-15T05:50:12.071 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7f631ab18700 1 -- 172.21.15.151:0/289053481 shutdown_connections 2022-03-15T05:50:12.071 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7f631ab18700 1 --2- 172.21.15.151:0/289053481 >> v2:172.21.15.151:3300/0 conn(0x7f6314152330 0x7f6314155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.071 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7f631ab18700 1 --2- 172.21.15.151:0/289053481 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6314151300 0x7f6314151df0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.072 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7f631ab18700 1 -- 172.21.15.151:0/289053481 >> 172.21.15.151:0/289053481 conn(0x7f63140c75c0 msgr2=0x7f63140c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.072 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7efffc9d8700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efff80c08d0 0x7efff814c250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efff000bb00 tx=0x7efff0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.073 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7fbb827fc700 1 -- 172.21.15.151:0/3803169452 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c004a10 con 0x7fbb9406edc0 2022-03-15T05:50:12.073 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7fbb827fc700 1 -- 172.21.15.151:0/3803169452 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c004b90 con 0x7fbb9406edc0 2022-03-15T05:50:12.073 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7fbb827fc700 1 -- 172.21.15.151:0/3803169452 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c00a9f0 con 0x7fbb9406edc0 2022-03-15T05:50:12.073 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7fbb98e19700 1 -- 172.21.15.151:0/3803169452 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb940befb0 con 0x7fbb9406edc0 2022-03-15T05:50:12.074 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7fbb98e19700 1 -- 172.21.15.151:0/3803169452 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb940c07f0 con 0x7fbb9406edc0 2022-03-15T05:50:12.074 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7fbb98e19700 1 -- 172.21.15.151:0/3803169452 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb940704b0 con 0x7fbb9406edc0 2022-03-15T05:50:12.074 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7efff4ff9700 1 -- 172.21.15.151:0/580977276 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000c740 con 0x7efff80c08d0 2022-03-15T05:50:12.075 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7f631ab18700 1 -- 172.21.15.151:0/289053481 shutdown_connections 2022-03-15T05:50:12.075 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7efff4ff9700 1 -- 172.21.15.151:0/580977276 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff000c8c0 con 0x7efff80c08d0 2022-03-15T05:50:12.076 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7efff4ff9700 1 -- 172.21.15.151:0/580977276 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff000cc80 con 0x7efff80c08d0 2022-03-15T05:50:12.076 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7f631ab18700 1 -- 172.21.15.151:0/289053481 wait complete. 2022-03-15T05:50:12.077 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.984+0000 7f84d37fe700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84b4063470 0x7f84b4065920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b890 tx=0x7f84c4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.077 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.985+0000 7f631ab18700 1 Processor -- start 2022-03-15T05:50:12.077 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.985+0000 7f631ab18700 1 -- start start 2022-03-15T05:50:12.078 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.984+0000 7efffec3c700 1 -- 172.21.15.151:0/580977276 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efff8165400 con 0x7efff80c08d0 2022-03-15T05:50:12.078 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.984+0000 7efffec3c700 1 -- 172.21.15.151:0/580977276 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efff814dde0 con 0x7efff80c08d0 2022-03-15T05:50:12.078 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.986+0000 7efffec3c700 1 -- 172.21.15.151:0/580977276 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efff8067990 con 0x7efff80c08d0 2022-03-15T05:50:12.079 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.985+0000 7fbb827fc700 1 -- 172.21.15.151:0/3803169452 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fbb8c007170 con 0x7fbb9406edc0 2022-03-15T05:50:12.080 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.980+0000 7ffa8f7fe700 1 --2- 172.21.15.151:0/2751754927 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa7c004690 0x7ffa7c004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.080 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7ffa8ffff700 1 --2- 172.21.15.151:0/2751754927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa7c0038e0 0x7ffa7c003cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.080 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7ffa8f7fe700 1 -- 172.21.15.151:0/2751754927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c005290 msgr2=0x7ffa7c00b940 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-03-15T05:50:12.080 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7ffa8f7fe700 1 --2- 172.21.15.151:0/2751754927 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c005290 0x7ffa7c00b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.081 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7ffa8f7fe700 1 -- 172.21.15.151:0/2751754927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa7c0038e0 msgr2=0x7ffa7c003cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:12.081 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7ffa8f7fe700 1 --2- 172.21.15.151:0/2751754927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa7c0038e0 0x7ffa7c003cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.081 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7ffa8f7fe700 1 -- 172.21.15.151:0/2751754927 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa901599d0 con 0x7ffa7c004690 2022-03-15T05:50:12.081 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7ffa8f7fe700 1 --2- 172.21.15.151:0/2751754927 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa7c004690 0x7ffa7c004b00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009870 tx=0x7ffa80006e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=534b013cf551eeab server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.082 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7ffa94aea700 1 -- 172.21.15.151:0/2751754927 reap_dead start 2022-03-15T05:50:12.082 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80011420 con 0x7ffa7c004690 2022-03-15T05:50:12.082 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa80011580 con 0x7ffa7c004690 2022-03-15T05:50:12.082 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.982+0000 7ffa8effd700 1 -- 172.21.15.151:0/2751754927 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa80011900 con 0x7ffa7c004690 2022-03-15T05:50:12.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.983+0000 7ffa9654d700 1 -- 172.21.15.151:0/2751754927 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa7c004690 msgr2=0x7ffa7c004b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.983+0000 7ffa9654d700 1 --2- 172.21.15.151:0/2751754927 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa7c004690 0x7ffa7c004b00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffa80009870 tx=0x7ffa80006e50 comp rx=0 tx=0).stop 2022-03-15T05:50:12.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.983+0000 7ffa9654d700 1 -- 172.21.15.151:0/2751754927 shutdown_connections 2022-03-15T05:50:12.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.983+0000 7ffa9654d700 1 --2- 172.21.15.151:0/2751754927 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa7c004690 0x7ffa7c004b00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.084 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.983+0000 7ffa9654d700 1 -- 172.21.15.151:0/2751754927 >> 172.21.15.151:0/2751754927 conn(0x7ffa900c75c0 msgr2=0x7ffa900c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.084 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.983+0000 7f46e37fe700 1 -- 172.21.15.151:0/1186151317 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc00bb30 con 0x7f46e40c08d0 2022-03-15T05:50:12.084 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.983+0000 7f46e37fe700 1 -- 172.21.15.151:0/1186151317 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46dc00bc90 con 0x7f46e40c08d0 2022-03-15T05:50:12.085 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.983+0000 7f46e37fe700 1 -- 172.21.15.151:0/1186151317 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46dc003860 con 0x7f46e40c08d0 2022-03-15T05:50:12.085 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.984+0000 7f46eab61700 1 -- 172.21.15.151:0/1186151317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e40c08d0 msgr2=0x7f46e4151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.085 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.984+0000 7f46eab61700 1 --2- 172.21.15.151:0/1186151317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e40c08d0 0x7f46e4151300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009e60 tx=0x7f46dc009780 comp rx=0 tx=0).stop 2022-03-15T05:50:12.086 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.981+0000 7f791aaca700 1 -- 172.21.15.151:0/587334002 wait complete. 2022-03-15T05:50:12.086 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.986+0000 7ffa9654d700 1 -- 172.21.15.151:0/2751754927 shutdown_connections 2022-03-15T05:50:12.087 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.984+0000 7f791aaca700 1 Processor -- start 2022-03-15T05:50:12.087 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.984+0000 7f791aaca700 1 -- start start 2022-03-15T05:50:12.088 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.986+0000 7f791aaca700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.088 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.986+0000 7f791aaca700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7914067c20 0x7f79140670d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.088 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.986+0000 7f791aaca700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79140c4090 0x7f7914185bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.088 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.986+0000 7f791aaca700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79140c0540 con 0x7f7914067c20 2022-03-15T05:50:12.089 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.986+0000 7f791aaca700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7914152230 con 0x7f79140c4090 2022-03-15T05:50:12.089 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.986+0000 7f791aaca700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7914151620 con 0x7f7914066b40 2022-03-15T05:50:12.090 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7f631ab18700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63140c3d00 0x7f631414dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.090 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7f631ab18700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6314151300 0x7f6314171f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.090 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7f631ab18700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6314152330 0x7f63140c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.090 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7f631ab18700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b4fa0 con 0x7f63140c3d00 2022-03-15T05:50:12.091 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7f631ab18700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f631414e2d0 con 0x7f6314151300 2022-03-15T05:50:12.091 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7f631ab18700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63140b4320 con 0x7f6314152330 2022-03-15T05:50:12.092 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7f7918866700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.092 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7f7918866700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60184/0 (socket says 172.21.15.151:60184) 2022-03-15T05:50:12.092 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7f7918866700 1 -- 172.21.15.151:0/2135541722 learned_addr learned my addr 172.21.15.151:0/2135541722 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:12.093 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f63190b5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6314152330 0x7f63140c2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.093 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f63190b5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6314152330 0x7f63140c2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60186/0 (socket says 172.21.15.151:60186) 2022-03-15T05:50:12.093 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f63190b5700 1 -- 172.21.15.151:0/137710410 learned_addr learned my addr 172.21.15.151:0/137710410 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:12.093 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f63188b4700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63140c3d00 0x7f631414dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.094 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f6313fff700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6314151300 0x7f6314171f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.094 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f63190b5700 1 -- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6314151300 msgr2=0x7f6314171f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.094 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f63190b5700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6314151300 0x7f6314171f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.094 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f63190b5700 1 -- 172.21.15.151:0/137710410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63140c3d00 msgr2=0x7f631414dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.095 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f63190b5700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63140c3d00 0x7f631414dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.095 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f63190b5700 1 -- 172.21.15.151:0/137710410 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63000092a0 con 0x7f6314152330 2022-03-15T05:50:12.095 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.989+0000 7f63190b5700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6314152330 0x7f63140c2380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f630c00b790 tx=0x7f630c009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.096 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f7913fff700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7914067c20 0x7f79140670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.096 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f7918866700 1 -- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79140c4090 msgr2=0x7f7914185bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.096 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f7919067700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79140c4090 0x7f7914185bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.096 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f7918866700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79140c4090 0x7f7914185bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.097 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f7918866700 1 -- 172.21.15.151:0/2135541722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7914067c20 msgr2=0x7f79140670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.097 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f7918866700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7914067c20 0x7f79140670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.097 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7f7918866700 1 -- 172.21.15.151:0/2135541722 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7900009370 con 0x7f7914066b40 2022-03-15T05:50:12.097 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.989+0000 7f7919067700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79140c4090 0x7f7914185bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-15T05:50:12.098 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7fbb827fc700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbb78063990 0x7fbb78065e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.098 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7fbb827fc700 1 -- 172.21.15.151:0/3803169452 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbb8c080d50 con 0x7fbb9406edc0 2022-03-15T05:50:12.098 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.987+0000 7fbb9259c700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbb78063990 0x7fbb78065e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.099 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7fbb827fc700 1 -- 172.21.15.151:0/3803169452 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fbb8c04fdf0 con 0x7fbb9406edc0 2022-03-15T05:50:12.099 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.989+0000 7f7918866700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c0000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7900008000 tx=0x7f7900017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.100 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.988+0000 7ffa9654d700 1 -- 172.21.15.151:0/2751754927 wait complete. 2022-03-15T05:50:12.100 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.990+0000 7f7910ff9700 1 -- 172.21.15.151:0/2135541722 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790001f070 con 0x7f7914066b40 2022-03-15T05:50:12.100 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.990+0000 7f7910ff9700 1 -- 172.21.15.151:0/2135541722 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7900000bc0 con 0x7f7914066b40 2022-03-15T05:50:12.101 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.990+0000 7f791aaca700 1 -- 172.21.15.151:0/2135541722 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7914151900 con 0x7f7914066b40 2022-03-15T05:50:12.101 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.990+0000 7f7910ff9700 1 -- 172.21.15.151:0/2135541722 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7900011b50 con 0x7f7914066b40 2022-03-15T05:50:12.101 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.990+0000 7f791aaca700 1 -- 172.21.15.151:0/2135541722 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7914151ec0 con 0x7f7914066b40 2022-03-15T05:50:12.101 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.991+0000 7ffa9654d700 1 Processor -- start 2022-03-15T05:50:12.102 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7f6310ff9700 1 -- 172.21.15.151:0/137710410 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c00f670 con 0x7f6314152330 2022-03-15T05:50:12.102 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7f6310ff9700 1 -- 172.21.15.151:0/137710410 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630c00f7d0 con 0x7f6314152330 2022-03-15T05:50:12.103 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7f6310ff9700 1 -- 172.21.15.151:0/137710410 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630c00fb90 con 0x7f6314152330 2022-03-15T05:50:12.103 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.990+0000 7efff4ff9700 1 -- 172.21.15.151:0/580977276 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7efff001b030 con 0x7efff80c08d0 2022-03-15T05:50:12.103 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.991+0000 7efff4ff9700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7effd8063510 0x7effd80659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.104 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.991+0000 7efff4ff9700 1 -- 172.21.15.151:0/580977276 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7efff007f8f0 con 0x7efff80c08d0 2022-03-15T05:50:12.104 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7efff7fff700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7effd8063510 0x7effd80659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.104 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7fbb9259c700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbb78063990 0x7fbb78065e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009760 tx=0x7fbb84016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.105 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7f46eab61700 1 -- 172.21.15.151:0/1186151317 shutdown_connections 2022-03-15T05:50:12.105 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7f46eab61700 1 --2- 172.21.15.151:0/1186151317 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e40c08d0 0x7f46e4151300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.105 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7f46eab61700 1 --2- 172.21.15.151:0/1186151317 >> v2:172.21.15.151:3300/0 conn(0x7f46e4151df0 0x7f46e4152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.106 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7f46eab61700 1 -- 172.21.15.151:0/1186151317 >> 172.21.15.151:0/1186151317 conn(0x7f46e40c75c0 msgr2=0x7f46e40c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.106 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.993+0000 7f791aaca700 1 -- 172.21.15.151:0/2135541722 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f0005130 con 0x7f7914066b40 2022-03-15T05:50:12.106 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.991+0000 7ffa9654d700 1 -- start start 2022-03-15T05:50:12.107 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.993+0000 7efff7fff700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7effd8063510 0x7effd80659c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7effe8009310 tx=0x7effe8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.108 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7f631ab18700 1 -- 172.21.15.151:0/137710410 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63140b4600 con 0x7f6314152330 2022-03-15T05:50:12.108 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.992+0000 7f631ab18700 1 -- 172.21.15.151:0/137710410 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63140b4bc0 con 0x7f6314152330 2022-03-15T05:50:12.108 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7ffa9654d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c004690 0x7ffa90169270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.109 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7ffa9654d700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa900b4880 0x7ffa900c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.109 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7ffa9654d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa900c04a0 0x7ffa900c0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.109 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7ffa9654d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa90159cb0 con 0x7ffa900c04a0 2022-03-15T05:50:12.109 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7ffa9654d700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900b53d0 con 0x7ffa7c004690 2022-03-15T05:50:12.110 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7ffa9654d700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa900bf7b0 con 0x7ffa900b4880 2022-03-15T05:50:12.111 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7f46eab61700 1 -- 172.21.15.151:0/1186151317 shutdown_connections 2022-03-15T05:50:12.111 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7ffa8ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c004690 0x7ffa90169270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.111 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7ffa8ffff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c004690 0x7ffa90169270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57292/0 (socket says 172.21.15.151:57292) 2022-03-15T05:50:12.112 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7ffa8ffff700 1 -- 172.21.15.151:0/1468821286 learned_addr learned my addr 172.21.15.151:0/1468821286 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:12.112 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.995+0000 7ffa94aea700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa900c04a0 0x7ffa900c0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.113 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.995+0000 7efff4ff9700 1 -- 172.21.15.151:0/580977276 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7efff004e8b0 con 0x7efff80c08d0 2022-03-15T05:50:12.113 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.996+0000 7ffa94aea700 1 -- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa900b4880 msgr2=0x7ffa900c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.114 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.996+0000 7ffa94aea700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa900b4880 0x7ffa900c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.114 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.996+0000 7ffa94aea700 1 -- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c004690 msgr2=0x7ffa90169270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.114 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.996+0000 7ffa94aea700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c004690 0x7ffa90169270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.114 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.996+0000 7ffa94aea700 1 -- 172.21.15.151:0/1468821286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa900c0010 con 0x7ffa900c04a0 2022-03-15T05:50:12.115 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7f7910ff9700 1 -- 172.21.15.151:0/2135541722 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f790002c030 con 0x7f7914066b40 2022-03-15T05:50:12.115 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.996+0000 7f7910ff9700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f78fc063510 0x7f78fc0659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.115 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.996+0000 7f7910ff9700 1 -- 172.21.15.151:0/2135541722 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7900081390 con 0x7f7914066b40 2022-03-15T05:50:12.116 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.997+0000 7f7913fff700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f78fc063510 0x7f78fc0659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.116 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.997+0000 7ffa94aea700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa900c04a0 0x7ffa900c0910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffa9006ba30 tx=0x7ffa88007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.117 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.994+0000 7f46eab61700 1 -- 172.21.15.151:0/1186151317 wait complete. 2022-03-15T05:50:12.117 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.997+0000 7f46eab61700 1 Processor -- start 2022-03-15T05:50:12.117 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.997+0000 7f6310ff9700 1 -- 172.21.15.151:0/137710410 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f630c00d410 con 0x7f6314152330 2022-03-15T05:50:12.118 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.998+0000 7f7913fff700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f78fc063510 0x7f78fc0659c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7908007fd0 tx=0x7f7908009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.119 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.998+0000 7f6310ff9700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f62fc0634e0 0x7f62fc065990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.119 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.999+0000 7f6310ff9700 1 -- 172.21.15.151:0/137710410 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f630c07fe80 con 0x7f6314152330 2022-03-15T05:50:12.120 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.999+0000 7f63188b4700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f62fc0634e0 0x7f62fc065990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.120 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.000+0000 7f631ab18700 1 -- 172.21.15.151:0/137710410 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62f0005130 con 0x7f6314152330 2022-03-15T05:50:12.121 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.999+0000 7ffa77fff700 1 -- 172.21.15.151:0/1468821286 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88005c20 con 0x7ffa900c04a0 2022-03-15T05:50:12.121 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.000+0000 7ffa77fff700 1 -- 172.21.15.151:0/1468821286 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa88005d80 con 0x7ffa900c04a0 2022-03-15T05:50:12.121 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.000+0000 7ffa77fff700 1 -- 172.21.15.151:0/1468821286 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa88003a70 con 0x7ffa900c04a0 2022-03-15T05:50:12.122 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.997+0000 7f46eab61700 1 -- start start 2022-03-15T05:50:12.122 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.999+0000 7f46eab61700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e40c08d0 0x7f46e40c4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.122 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.999+0000 7f46eab61700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46e4151df0 0x7f46e416c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.122 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.999+0000 7f46eab61700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e4153e10 0x7f46e40bc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.123 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.999+0000 7f46eab61700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e416c2e0 con 0x7f46e40c08d0 2022-03-15T05:50:12.123 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.999+0000 7f46eab61700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e416bcb0 con 0x7f46e4151df0 2022-03-15T05:50:12.123 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:11.999+0000 7f46eab61700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40be440 con 0x7f46e4153e10 2022-03-15T05:50:12.123 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.000+0000 7f46e3fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46e4151df0 0x7f46e416c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.124 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.000+0000 7f46e90fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e4153e10 0x7f46e40bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.124 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.000+0000 7f46e90fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e4153e10 0x7f46e40bc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60190/0 (socket says 172.21.15.151:60190) 2022-03-15T05:50:12.124 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.000+0000 7f46e90fe700 1 -- 172.21.15.151:0/2739805557 learned_addr learned my addr 172.21.15.151:0/2739805557 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:12.125 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.001+0000 7ffa9654d700 1 -- 172.21.15.151:0/1468821286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa901697b0 con 0x7ffa900c04a0 2022-03-15T05:50:12.125 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.001+0000 7f46e88fd700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e40c08d0 0x7f46e40c4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.125 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.001+0000 7f46e3fff700 1 -- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e4153e10 msgr2=0x7f46e40bc910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.125 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.001+0000 7f46e3fff700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e4153e10 0x7f46e40bc910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.126 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.001+0000 7f46e3fff700 1 -- 172.21.15.151:0/2739805557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e40c08d0 msgr2=0x7f46e40c4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.126 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.001+0000 7f46e3fff700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e40c08d0 0x7f46e40c4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.126 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.001+0000 7f46e3fff700 1 -- 172.21.15.151:0/2739805557 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46dc009a20 con 0x7f46e4151df0 2022-03-15T05:50:12.126 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.001+0000 7f46e88fd700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e40c08d0 0x7f46e40c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2022-03-15T05:50:12.127 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.000+0000 7f7910ff9700 1 -- 172.21.15.151:0/2135541722 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f79000503b0 con 0x7f7914066b40 2022-03-15T05:50:12.127 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.002+0000 7f46e3fff700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46e4151df0 0x7f46e416c700 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f46d800d6e0 tx=0x7f46d8008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.128 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.002+0000 7f63188b4700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f62fc0634e0 0x7f62fc065990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6308005750 tx=0x7f6308009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.128 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.001+0000 7ffa9654d700 1 -- 172.21.15.151:0/1468821286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa900b50f0 con 0x7ffa900c04a0 2022-03-15T05:50:12.129 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.002+0000 7f46e0ff9700 1 -- 172.21.15.151:0/2739805557 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8004240 con 0x7f46e4151df0 2022-03-15T05:50:12.129 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.002+0000 7f46e0ff9700 1 -- 172.21.15.151:0/2739805557 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d80043a0 con 0x7f46e4151df0 2022-03-15T05:50:12.129 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.002+0000 7f46e0ff9700 1 -- 172.21.15.151:0/2739805557 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8003710 con 0x7f46e4151df0 2022-03-15T05:50:12.129 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.003+0000 7f46eab61700 1 -- 172.21.15.151:0/2739805557 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e40be6e0 con 0x7f46e4151df0 2022-03-15T05:50:12.130 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.003+0000 7f46eab61700 1 -- 172.21.15.151:0/2739805557 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e40c67d0 con 0x7f46e4151df0 2022-03-15T05:50:12.130 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.004+0000 7ffa9654d700 1 -- 172.21.15.151:0/1468821286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa900c01c0 con 0x7ffa900c04a0 2022-03-15T05:50:12.131 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.005+0000 7f6310ff9700 1 -- 172.21.15.151:0/137710410 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f630c04ee40 con 0x7f6314152330 2022-03-15T05:50:12.132 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.008+0000 7f46e0ff9700 1 -- 172.21.15.151:0/2739805557 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f46d8021070 con 0x7f46e4151df0 2022-03-15T05:50:12.132 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.009+0000 7f46e0ff9700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f46c4063510 0x7f46c40659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.132 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.009+0000 7f46e0ff9700 1 -- 172.21.15.151:0/2739805557 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f46d807fa40 con 0x7f46e4151df0 2022-03-15T05:50:12.132 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.010+0000 7f46eab61700 1 -- 172.21.15.151:0/2739805557 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e404b760 con 0x7f46e4151df0 2022-03-15T05:50:12.133 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.010+0000 7f46e88fd700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f46c4063510 0x7f46c40659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.133 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.006+0000 7ffa77fff700 1 -- 172.21.15.151:0/1468821286 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7ffa88010070 con 0x7ffa900c04a0 2022-03-15T05:50:12.133 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.007+0000 7ffa77fff700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ffa70063490 0x7ffa70065940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:12.134 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.011+0000 7f46e88fd700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f46c4063510 0x7f46c40659c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009e60 tx=0x7f46dc01a000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.135 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.012+0000 7ffa8ffff700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ffa70063490 0x7ffa70065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:12.135 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.013+0000 7ffa77fff700 1 -- 172.21.15.151:0/1468821286 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffa88051b50 con 0x7ffa900c04a0 2022-03-15T05:50:12.135 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.014+0000 7ffa8ffff700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ffa70063490 0x7ffa70065940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa84001eb0 tx=0x7ffa84007040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:12.136 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.016+0000 7ffa77fff700 1 -- 172.21.15.151:0/1468821286 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7ffa900c01c0 con 0x7ffa900c04a0 2022-03-15T05:50:12.136 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.016+0000 7f46e0ff9700 1 -- 172.21.15.151:0/2739805557 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f46d8015020 con 0x7f46e4151df0 2022-03-15T05:50:12.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.364+0000 7f3a1dca3700 1 -- 172.21.15.151:0/3092842156 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f3a1804b760 con 0x7f3a18067c20 2022-03-15T05:50:12.370 INFO:teuthology.orchestra.run.smithi151.stdout:60129542151 2022-03-15T05:50:12.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.364+0000 7f39ff7fe700 1 -- 172.21.15.151:0/3092842156 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3a1001a070 con 0x7f3a18067c20 2022-03-15T05:50:12.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.369+0000 7f3a1dca3700 1 -- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f39f8063510 msgr2=0x7f39f80659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.369+0000 7f3a1dca3700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f39f8063510 0x7f39f80659c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a08006fd0 tx=0x7f3a08017000 comp rx=0 tx=0).stop 2022-03-15T05:50:12.371 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.369+0000 7f3a1dca3700 1 -- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18067c20 msgr2=0x7f3a18069d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.369+0000 7f3a1dca3700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18067c20 0x7f3a18069d50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3a1000e1c0 tx=0x7f3a10009920 comp rx=0 tx=0).stop 2022-03-15T05:50:12.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.370+0000 7f3a1dca3700 1 -- 172.21.15.151:0/3092842156 shutdown_connections 2022-03-15T05:50:12.372 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.370+0000 7f3a1dca3700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f39f8063510 0x7f39f80659c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.370+0000 7f3a1dca3700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3a180c4090 0x7f3a1806a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.370+0000 7f3a1dca3700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a18066b40 0x7f3a18146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.370+0000 7f3a1dca3700 1 --2- 172.21.15.151:0/3092842156 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3a18067c20 0x7f3a18069d50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.373 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.370+0000 7f3a1dca3700 1 -- 172.21.15.151:0/3092842156 >> 172.21.15.151:0/3092842156 conn(0x7f3a180c75c0 msgr2=0x7f3a18066fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.370+0000 7f3a1dca3700 1 -- 172.21.15.151:0/3092842156 shutdown_connections 2022-03-15T05:50:12.374 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.371+0000 7f3a1dca3700 1 -- 172.21.15.151:0/3092842156 wait complete. 2022-03-15T05:50:12.393 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.391+0000 7f84d9d11700 1 -- 172.21.15.151:0/1347041853 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f84d404b760 con 0x7f84d4151530 2022-03-15T05:50:12.394 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.392+0000 7f84bb7fe700 1 -- 172.21.15.151:0/1347041853 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84cc055110 con 0x7f84d4151530 2022-03-15T05:50:12.394 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.392+0000 7f791aaca700 1 -- 172.21.15.151:0/2135541722 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f78f00053e0 con 0x7f7914066b40 2022-03-15T05:50:12.398 INFO:teuthology.orchestra.run.smithi151.stdout:60129542152 2022-03-15T05:50:12.399 INFO:teuthology.orchestra.run.smithi151.stdout:64424509447 2022-03-15T05:50:12.399 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.393+0000 7f7910ff9700 1 -- 172.21.15.151:0/2135541722 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f790002a090 con 0x7f7914066b40 2022-03-15T05:50:12.400 INFO:teuthology.orchestra.run.smithi151.stdout:64424509448 2022-03-15T05:50:12.400 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.393+0000 7fbb98e19700 1 -- 172.21.15.151:0/3803169452 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fbb940bf140 con 0x7fbb9406edc0 2022-03-15T05:50:12.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.393+0000 7fbb827fc700 1 -- 172.21.15.151:0/3803169452 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbb8c053410 con 0x7fbb9406edc0 2022-03-15T05:50:12.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.397+0000 7f791aaca700 1 -- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f78fc063510 msgr2=0x7f78fc0659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.401 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.397+0000 7f791aaca700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f78fc063510 0x7f78fc0659c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7908007fd0 tx=0x7f7908009040 comp rx=0 tx=0).stop 2022-03-15T05:50:12.402 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.397+0000 7f791aaca700 1 -- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 msgr2=0x7f79140c0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.402 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.397+0000 7f791aaca700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c0000 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7900008000 tx=0x7f7900017000 comp rx=0 tx=0).stop 2022-03-15T05:50:12.403 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 -- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84b4063470 msgr2=0x7f84b4065920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.403 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84b4063470 0x7f84b4065920 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f84c400b890 tx=0x7f84c4008040 comp rx=0 tx=0).stop 2022-03-15T05:50:12.403 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 -- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d4151530 msgr2=0x7f84d40bff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.403 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d4151530 0x7f84d40bff20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f84cc013000 tx=0x7f84cc019000 comp rx=0 tx=0).stop 2022-03-15T05:50:12.404 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 -- 172.21.15.151:0/1347041853 shutdown_connections 2022-03-15T05:50:12.404 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84b4063470 0x7f84b4065920 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.405 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84d4151530 0x7f84d40bff20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.405 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84d406d320 0x7f84d40c64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.405 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 --2- 172.21.15.151:0/1347041853 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84d414ae50 0x7f84d414fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.405 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 -- 172.21.15.151:0/1347041853 >> 172.21.15.151:0/1347041853 conn(0x7f84d40c75c0 msgr2=0x7f84d414a510 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.406 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7f84d9d11700 1 -- 172.21.15.151:0/1347041853 shutdown_connections 2022-03-15T05:50:12.406 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.398+0000 7fbb98e19700 1 -- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbb78063990 msgr2=0x7fbb78065e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.407 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.399+0000 7fbb98e19700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbb78063990 0x7fbb78065e40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009760 tx=0x7fbb84016000 comp rx=0 tx=0).stop 2022-03-15T05:50:12.407 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.399+0000 7fbb98e19700 1 -- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 msgr2=0x7fbb940bc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.407 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.399+0000 7fbb98e19700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bc8a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c00dcc0 tx=0x7fbb8c00d180 comp rx=0 tx=0).stop 2022-03-15T05:50:12.407 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.399+0000 7fbb98e19700 1 -- 172.21.15.151:0/3803169452 shutdown_connections 2022-03-15T05:50:12.408 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.399+0000 7fbb98e19700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbb78063990 0x7fbb78065e40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.408 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.399+0000 7fbb98e19700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbb9406edc0 0x7fbb940bc8a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.408 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.399+0000 7fbb98e19700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb94066980 0x7fbb940bf440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.408 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.399+0000 7fbb98e19700 1 --2- 172.21.15.151:0/3803169452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbb94067c20 0x7fbb941615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.409 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.399+0000 7fbb98e19700 1 -- 172.21.15.151:0/3803169452 >> 172.21.15.151:0/3803169452 conn(0x7fbb940c75c0 msgr2=0x7fbb94066de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.409 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.399+0000 7f84d9d11700 1 -- 172.21.15.151:0/1347041853 wait complete. 2022-03-15T05:50:12.410 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.400+0000 7fbb98e19700 1 -- 172.21.15.151:0/3803169452 shutdown_connections 2022-03-15T05:50:12.410 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.400+0000 7fbb98e19700 1 -- 172.21.15.151:0/3803169452 wait complete. 2022-03-15T05:50:12.411 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.400+0000 7f631ab18700 1 -- 172.21.15.151:0/137710410 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f62f00053e0 con 0x7f6314152330 2022-03-15T05:50:12.411 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.401+0000 7f6310ff9700 1 -- 172.21.15.151:0/137710410 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f630c052460 con 0x7f6314152330 2022-03-15T05:50:12.411 INFO:teuthology.orchestra.run.smithi151.stdout:60129542151 2022-03-15T05:50:12.412 INFO:teuthology.orchestra.run.smithi151.stdout:60129542152 2022-03-15T05:50:12.412 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.402+0000 7efffec3c700 1 -- 172.21.15.151:0/580977276 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7efff80be8d0 con 0x7efff80c08d0 2022-03-15T05:50:12.413 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.403+0000 7efff4ff9700 1 -- 172.21.15.151:0/580977276 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efff0019020 con 0x7efff80c08d0 2022-03-15T05:50:12.413 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.402+0000 7f791aaca700 1 -- 172.21.15.151:0/2135541722 shutdown_connections 2022-03-15T05:50:12.413 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.402+0000 7f791aaca700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f78fc063510 0x7f78fc0659c0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.414 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.402+0000 7f791aaca700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f79140c4090 0x7f7914185bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.414 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.402+0000 7f791aaca700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f7914066b40 0x7f79140c0000 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.414 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.402+0000 7f791aaca700 1 --2- 172.21.15.151:0/2135541722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7914067c20 0x7f79140670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.414 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.402+0000 7f791aaca700 1 -- 172.21.15.151:0/2135541722 >> 172.21.15.151:0/2135541722 conn(0x7f79140c75c0 msgr2=0x7f79140c1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.415 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.405+0000 7f631ab18700 1 -- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f62fc0634e0 msgr2=0x7f62fc065990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.415 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.405+0000 7f631ab18700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f62fc0634e0 0x7f62fc065990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6308005750 tx=0x7f6308009040 comp rx=0 tx=0).stop 2022-03-15T05:50:12.416 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.405+0000 7f631ab18700 1 -- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6314152330 msgr2=0x7f63140c2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.416 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.405+0000 7f631ab18700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6314152330 0x7f63140c2380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f630c00b790 tx=0x7f630c009330 comp rx=0 tx=0).stop 2022-03-15T05:50:12.416 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.406+0000 7f791aaca700 1 -- 172.21.15.151:0/2135541722 shutdown_connections 2022-03-15T05:50:12.417 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.406+0000 7f791aaca700 1 -- 172.21.15.151:0/2135541722 wait complete. 2022-03-15T05:50:12.417 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.406+0000 7efffec3c700 1 -- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7effd8063510 msgr2=0x7effd80659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.417 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.406+0000 7efffec3c700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7effd8063510 0x7effd80659c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7effe8009310 tx=0x7effe8017000 comp rx=0 tx=0).stop 2022-03-15T05:50:12.418 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.406+0000 7efffec3c700 1 -- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efff80c08d0 msgr2=0x7efff814c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.418 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.406+0000 7efffec3c700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efff80c08d0 0x7efff814c250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efff000bb00 tx=0x7efff0009780 comp rx=0 tx=0).stop 2022-03-15T05:50:12.418 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7f631ab18700 1 -- 172.21.15.151:0/137710410 shutdown_connections 2022-03-15T05:50:12.419 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7f631ab18700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f62fc0634e0 0x7f62fc065990 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.419 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7f631ab18700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f6314152330 0x7f63140c2380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.419 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7f631ab18700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f63140c3d00 0x7f631414dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.419 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7f631ab18700 1 --2- 172.21.15.151:0/137710410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6314151300 0x7f6314171f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.420 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7f631ab18700 1 -- 172.21.15.151:0/137710410 >> 172.21.15.151:0/137710410 conn(0x7f63140c75c0 msgr2=0x7f631414a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.420 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7f631ab18700 1 -- 172.21.15.151:0/137710410 shutdown_connections 2022-03-15T05:50:12.420 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7efffec3c700 1 -- 172.21.15.151:0/580977276 shutdown_connections 2022-03-15T05:50:12.421 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7efffec3c700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7effd8063510 0x7effd80659c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.421 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7efffec3c700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efff8152330 0x7efff81443e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.421 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7efffec3c700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efff80c08d0 0x7efff814c250 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.421 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7efffec3c700 1 --2- 172.21.15.151:0/580977276 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7efff80c3d00 0x7efff80bf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.422 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.407+0000 7efffec3c700 1 -- 172.21.15.151:0/580977276 >> 172.21.15.151:0/580977276 conn(0x7efff80c75c0 msgr2=0x7efff806a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.422 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.408+0000 7f631ab18700 1 -- 172.21.15.151:0/137710410 wait complete. 2022-03-15T05:50:12.423 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.410+0000 7efffec3c700 1 -- 172.21.15.151:0/580977276 shutdown_connections 2022-03-15T05:50:12.423 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.410+0000 7efffec3c700 1 -- 172.21.15.151:0/580977276 wait complete. 2022-03-15T05:50:12.424 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.1 2022-03-15T05:50:12.425 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.420+0000 7ffa9654d700 1 -- 172.21.15.151:0/1468821286 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ffa900c01c0 con 0x7ffa900c04a0 2022-03-15T05:50:12.425 INFO:teuthology.orchestra.run.smithi151.stdout:60129542152 2022-03-15T05:50:12.426 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.421+0000 7ffa77fff700 1 -- 172.21.15.151:0/1468821286 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffa900c01c0 con 0x7ffa900c04a0 2022-03-15T05:50:12.427 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.424+0000 7ffa9654d700 1 -- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ffa70063490 msgr2=0x7ffa70065940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.427 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.424+0000 7ffa9654d700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ffa70063490 0x7ffa70065940 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa84001eb0 tx=0x7ffa84007040 comp rx=0 tx=0).stop 2022-03-15T05:50:12.427 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.424+0000 7ffa9654d700 1 -- 172.21.15.151:0/1468821286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa900c04a0 msgr2=0x7ffa900c0910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.427 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.424+0000 7ffa9654d700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa900c04a0 0x7ffa900c0910 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ffa9006ba30 tx=0x7ffa88007f10 comp rx=0 tx=0).stop 2022-03-15T05:50:12.428 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.424+0000 7ffa9654d700 1 -- 172.21.15.151:0/1468821286 shutdown_connections 2022-03-15T05:50:12.428 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.424+0000 7ffa9654d700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ffa70063490 0x7ffa70065940 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.428 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.424+0000 7ffa9654d700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa900c04a0 0x7ffa900c0910 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.428 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.424+0000 7ffa9654d700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa7c004690 0x7ffa90169270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.429 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.424+0000 7ffa9654d700 1 --2- 172.21.15.151:0/1468821286 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ffa900b4880 0x7ffa900c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.429 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.425+0000 7ffa9654d700 1 -- 172.21.15.151:0/1468821286 >> 172.21.15.151:0/1468821286 conn(0x7ffa900c75c0 msgr2=0x7ffa900c5860 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.429 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.425+0000 7f46eab61700 1 -- 172.21.15.151:0/2739805557 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f46e406cef0 con 0x7f46e4151df0 2022-03-15T05:50:12.430 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.425+0000 7f46e0ff9700 1 -- 172.21.15.151:0/2739805557 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f46d801f020 con 0x7f46e4151df0 2022-03-15T05:50:12.430 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.425+0000 7ffa9654d700 1 -- 172.21.15.151:0/1468821286 shutdown_connections 2022-03-15T05:50:12.431 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.425+0000 7ffa9654d700 1 -- 172.21.15.151:0/1468821286 wait complete. 2022-03-15T05:50:12.431 INFO:teuthology.orchestra.run.smithi151.stdout:60129542151 2022-03-15T05:50:12.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 -- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f46c4063510 msgr2=0x7f46c40659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f46c4063510 0x7f46c40659c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f46dc009e60 tx=0x7f46dc01a000 comp rx=0 tx=0).stop 2022-03-15T05:50:12.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 -- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46e4151df0 msgr2=0x7f46e416c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:12.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46e4151df0 0x7f46e416c700 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f46d800d6e0 tx=0x7f46d8008040 comp rx=0 tx=0).stop 2022-03-15T05:50:12.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 -- 172.21.15.151:0/2739805557 shutdown_connections 2022-03-15T05:50:12.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f46c4063510 0x7f46c40659c0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f46e4153e10 0x7f46e40bc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46e40c08d0 0x7f46e40c4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.434 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 --2- 172.21.15.151:0/2739805557 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46e4151df0 0x7f46e416c700 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:12.434 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 -- 172.21.15.151:0/2739805557 >> 172.21.15.151:0/2739805557 conn(0x7f46e40c75c0 msgr2=0x7f46e40bd490 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:12.434 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.429+0000 7f46eab61700 1 -- 172.21.15.151:0/2739805557 shutdown_connections 2022-03-15T05:50:12.434 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:12.430+0000 7f46eab61700 1 -- 172.21.15.151:0/2739805557 wait complete. 2022-03-15T05:50:12.445 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.0 2022-03-15T05:50:12.451 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2022-03-15T05:50:12.454 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.2 2022-03-15T05:50:12.455 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.4 2022-03-15T05:50:12.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.6 2022-03-15T05:50:12.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.7 2022-03-15T05:50:12.464 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.5 2022-03-15T05:50:13.425 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2022-03-15T05:50:13.446 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2022-03-15T05:50:13.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2022-03-15T05:50:13.455 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2022-03-15T05:50:13.456 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-03-15T05:50:13.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2022-03-15T05:50:13.465 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2022-03-15T05:50:13.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2022-03-15T05:50:13.756 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.749+0000 7f3742f17700 1 Processor -- start 2022-03-15T05:50:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.749+0000 7f3742f17700 1 -- start start 2022-03-15T05:50:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.751+0000 7f3742f17700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c066b40 0x7f373c0bdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.752+0000 7f3742f17700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f373c0c2a40 0x7f373c06c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.752+0000 7f3742f17700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f373c0c25b0 con 0x7f373c06edc0 2022-03-15T05:50:13.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.752+0000 7f3742f17700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f373c067fd0 con 0x7f373c0c2a40 2022-03-15T05:50:13.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.752+0000 7f3742f17700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0c4210 con 0x7f373c066b40 2022-03-15T05:50:13.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.753+0000 7f3740cb3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c066b40 0x7f373c0bdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.753+0000 7f3740cb3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c066b40 0x7f373c0bdf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60192/0 (socket says 172.21.15.151:60192) 2022-03-15T05:50:13.759 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.753+0000 7f3740cb3700 1 -- 172.21.15.151:0/3455009814 learned_addr learned my addr 172.21.15.151:0/3455009814 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.759 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.755+0000 7f37414b4700 1 --2- 172.21.15.151:0/3455009814 >> v2:172.21.15.151:3300/0 conn(0x7f373c0c2a40 0x7f373c06c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.756+0000 7f3740cb3700 1 -- 172.21.15.151:0/3455009814 >> v2:172.21.15.151:3300/0 conn(0x7f373c0c2a40 msgr2=0x7f373c06c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:13.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.756+0000 7f3740cb3700 1 --2- 172.21.15.151:0/3455009814 >> v2:172.21.15.151:3300/0 conn(0x7f373c0c2a40 0x7f373c06c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.756+0000 7f3740cb3700 1 -- 172.21.15.151:0/3455009814 >> v1:172.21.15.164:6789/0 conn(0x7f373c06edc0 legacy=0x7f373c066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:13.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.756+0000 7f3740cb3700 1 -- 172.21.15.151:0/3455009814 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f373c0c1fa0 con 0x7f373c066b40 2022-03-15T05:50:13.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.758+0000 7f3740cb3700 1 --2- 172.21.15.151:0/3455009814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c066b40 0x7f373c0bdf90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f372c006fd0 tx=0x7f372c009dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59759dc70bbdd2e2 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.758+0000 7f373b7fe700 1 -- 172.21.15.151:0/3455009814 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c00c700 con 0x7f373c066b40 2022-03-15T05:50:13.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.758+0000 7f373b7fe700 1 -- 172.21.15.151:0/3455009814 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f372c00c860 con 0x7f373c066b40 2022-03-15T05:50:13.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.758+0000 7f373b7fe700 1 -- 172.21.15.151:0/3455009814 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f372c00cc00 con 0x7f373c066b40 2022-03-15T05:50:13.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.759+0000 7f3742f17700 1 -- 172.21.15.151:0/3455009814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c066b40 msgr2=0x7f373c0bdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.759+0000 7f3742f17700 1 --2- 172.21.15.151:0/3455009814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c066b40 0x7f373c0bdf90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f372c006fd0 tx=0x7f372c009dd0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.763 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.760+0000 7f3742f17700 1 -- 172.21.15.151:0/3455009814 shutdown_connections 2022-03-15T05:50:13.763 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.760+0000 7f3742f17700 1 --2- 172.21.15.151:0/3455009814 >> v2:172.21.15.151:3300/0 conn(0x7f373c0c2a40 0x7f373c06c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.763 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.760+0000 7f3742f17700 1 --2- 172.21.15.151:0/3455009814 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c066b40 0x7f373c0bdf90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.763 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.760+0000 7f3742f17700 1 -- 172.21.15.151:0/3455009814 >> 172.21.15.151:0/3455009814 conn(0x7f373c0c75c0 msgr2=0x7f373c0c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:13.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.761+0000 7f3742f17700 1 -- 172.21.15.151:0/3455009814 shutdown_connections 2022-03-15T05:50:13.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.761+0000 7f3742f17700 1 -- 172.21.15.151:0/3455009814 wait complete. 2022-03-15T05:50:13.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.764+0000 7f3742f17700 1 Processor -- start 2022-03-15T05:50:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.764+0000 7f3742f17700 1 -- start start 2022-03-15T05:50:13.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.765+0000 7f3742f17700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f373c066b40 0x7f373c0c13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.766+0000 7f3742f17700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c06edc0 0x7f373c15d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.766+0000 7f3742f17700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f373c0c2a40 0x7f373c15a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.766+0000 7f3742f17700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0c0db0 con 0x7f373c066b40 2022-03-15T05:50:13.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.766+0000 7f3742f17700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373c087830 con 0x7f373c0c2a40 2022-03-15T05:50:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.766+0000 7f3742f17700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f373c0c07f0 con 0x7f373c06edc0 2022-03-15T05:50:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.768+0000 7f373bfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c06edc0 0x7f373c15d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.768+0000 7f373bfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c06edc0 0x7f373c15d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60194/0 (socket says 172.21.15.151:60194) 2022-03-15T05:50:13.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.768+0000 7f373bfff700 1 -- 172.21.15.151:0/918383966 learned_addr learned my addr 172.21.15.151:0/918383966 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.769+0000 7f3740cb3700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f373c066b40 0x7f373c0c13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.769+0000 7f373bfff700 1 -- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f373c0c2a40 msgr2=0x7f373c15a330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-15T05:50:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.769+0000 7f373bfff700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f373c0c2a40 0x7f373c15a330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.769+0000 7f373bfff700 1 -- 172.21.15.151:0/918383966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f373c066b40 msgr2=0x7f373c0c13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.770+0000 7f373bfff700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f373c066b40 0x7f373c0c13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.770+0000 7f373bfff700 1 -- 172.21.15.151:0/918383966 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372c0090c0 con 0x7f373c06edc0 2022-03-15T05:50:13.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.770+0000 7f373bfff700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c06edc0 0x7f373c15d570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f373400c840 tx=0x7f3734003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.775 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.771+0000 7f3738ff9700 1 -- 172.21.15.151:0/918383966 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734012630 con 0x7f373c06edc0 2022-03-15T05:50:13.775 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.771+0000 7f3738ff9700 1 -- 172.21.15.151:0/918383966 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37340127b0 con 0x7f373c06edc0 2022-03-15T05:50:13.775 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.771+0000 7f3738ff9700 1 -- 172.21.15.151:0/918383966 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3734012b70 con 0x7f373c06edc0 2022-03-15T05:50:13.775 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.771+0000 7f3742f17700 1 -- 172.21.15.151:0/918383966 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373c0c0ad0 con 0x7f373c06edc0 2022-03-15T05:50:13.776 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.771+0000 7f3742f17700 1 -- 172.21.15.151:0/918383966 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373c15b570 con 0x7f373c06edc0 2022-03-15T05:50:13.778 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.775+0000 7f3738ff9700 1 -- 172.21.15.151:0/918383966 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f3734022070 con 0x7f373c06edc0 2022-03-15T05:50:13.780 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.778+0000 7f3738ff9700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f371c063510 0x7f371c0659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.781 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.778+0000 7f3738ff9700 1 -- 172.21.15.151:0/918383966 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f373407fe70 con 0x7f373c06edc0 2022-03-15T05:50:13.781 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.779+0000 7f3740cb3700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f371c063510 0x7f371c0659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.790 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.788+0000 7f3742f17700 1 -- 172.21.15.151:0/918383966 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3718005130 con 0x7f373c06edc0 2022-03-15T05:50:13.790 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.788+0000 7f3740cb3700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f371c063510 0x7f371c0659c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f372c006fd0 tx=0x7f372c018000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.792 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.790+0000 7f0834357700 1 Processor -- start 2022-03-15T05:50:13.793 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.791+0000 7f0834357700 1 -- start start 2022-03-15T05:50:13.795 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.793+0000 7f0834357700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 0x7f082c151df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.795 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.793+0000 7f0834357700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c06db00 con 0x7f082c0c3d00 2022-03-15T05:50:13.795 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.793+0000 7f0834357700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f082c152790 con 0x7f082c152330 2022-03-15T05:50:13.796 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.793+0000 7f0834357700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082c06cc10 con 0x7f082c151300 2022-03-15T05:50:13.796 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.793+0000 7f3738ff9700 1 -- 172.21.15.151:0/918383966 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f3734052860 con 0x7f373c06edc0 2022-03-15T05:50:13.797 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.794+0000 7f08318f2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 0x7f082c151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.797 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.794+0000 7f08328f4700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f082c152330 0x7f082c066980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33678/0 (socket says 172.21.15.151:33678) 2022-03-15T05:50:13.797 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.794+0000 7f08328f4700 1 -- 172.21.15.151:0/2927616162 learned_addr learned my addr 172.21.15.151:0/2927616162 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:13.798 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.794+0000 7f08318f2700 1 -- 172.21.15.151:0/2927616162 >> v1:172.21.15.164:6789/0 conn(0x7f082c152330 legacy=0x7f082c066980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:13.798 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.794+0000 7f08318f2700 1 -- 172.21.15.151:0/2927616162 >> v1:172.21.15.151:6789/0 conn(0x7f082c0c3d00 legacy=0x7f082c0c08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:13.798 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.795+0000 7f08318f2700 1 -- 172.21.15.151:0/2927616162 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f082c06cef0 con 0x7f082c151300 2022-03-15T05:50:13.799 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.796+0000 7f08318f2700 1 --2- 172.21.15.151:0/2927616162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 0x7f082c151df0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0828009790 tx=0x7f0828009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d372aeeccead40e4 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.799 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.797+0000 7f08310f1700 1 -- 172.21.15.151:0/2927616162 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828004030 con 0x7f082c151300 2022-03-15T05:50:13.799 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.797+0000 7f08310f1700 1 -- 172.21.15.151:0/2927616162 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0828004190 con 0x7f082c151300 2022-03-15T05:50:13.800 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.797+0000 7f08310f1700 1 -- 172.21.15.151:0/2927616162 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828011630 con 0x7f082c151300 2022-03-15T05:50:13.800 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.798+0000 7f0834357700 1 -- 172.21.15.151:0/2927616162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 msgr2=0x7f082c151df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.801 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.798+0000 7f0834357700 1 --2- 172.21.15.151:0/2927616162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 0x7f082c151df0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0828009790 tx=0x7f0828009060 comp rx=0 tx=0).stop 2022-03-15T05:50:13.801 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.798+0000 7f0834357700 1 -- 172.21.15.151:0/2927616162 shutdown_connections 2022-03-15T05:50:13.801 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.799+0000 7f0834357700 1 --2- 172.21.15.151:0/2927616162 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 0x7f082c151df0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.801 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.799+0000 7f0834357700 1 -- 172.21.15.151:0/2927616162 >> 172.21.15.151:0/2927616162 conn(0x7f082c0c75c0 msgr2=0x7f082c0c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:13.806 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.799+0000 7f0834357700 1 -- 172.21.15.151:0/2927616162 shutdown_connections 2022-03-15T05:50:13.806 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.800+0000 7f0834357700 1 -- 172.21.15.151:0/2927616162 wait complete. 2022-03-15T05:50:13.807 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.802+0000 7f0834357700 1 Processor -- start 2022-03-15T05:50:13.809 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.802+0000 7f0834357700 1 -- start start 2022-03-15T05:50:13.809 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.804+0000 7f0834357700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f082c0c3d00 0x7f082c0c63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.809 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.804+0000 7f0834357700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 0x7f082c149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.809 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.804+0000 7f0834357700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f082c152330 0x7f082c0bc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.810 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.804+0000 7f0834357700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c0c6930 con 0x7f082c152330 2022-03-15T05:50:13.810 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.804+0000 7f0834357700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f082c16c500 con 0x7f082c0c3d00 2022-03-15T05:50:13.810 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.804+0000 7f0834357700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f082c16c770 con 0x7f082c151300 2022-03-15T05:50:13.811 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.808+0000 7f08328f4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f082c152330 0x7f082c0bc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.811 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.808+0000 7f08318f2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 0x7f082c149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.811 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.808+0000 7f08328f4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f082c152330 0x7f082c0bc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60088/0 (socket says 172.21.15.151:60088) 2022-03-15T05:50:13.811 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.808+0000 7f08328f4700 1 -- 172.21.15.151:0/1804285598 learned_addr learned my addr 172.21.15.151:0/1804285598 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.812 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.808+0000 7f08320f3700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f082c0c3d00 0x7f082c0c63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.815 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.809+0000 7f08318f2700 1 -- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f082c0c3d00 msgr2=0x7f082c0c63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.815 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.809+0000 7f08318f2700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f082c0c3d00 0x7f082c0c63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.815 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.809+0000 7f08318f2700 1 -- 172.21.15.151:0/1804285598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f082c152330 msgr2=0x7f082c0bc750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.815 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.809+0000 7f08318f2700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f082c152330 0x7f082c0bc750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.816 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.809+0000 7f08318f2700 1 -- 172.21.15.151:0/1804285598 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08280092a0 con 0x7f082c151300 2022-03-15T05:50:13.816 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.809+0000 7f08318f2700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 0x7f082c149130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0828015000 tx=0x7f0828013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.816 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.810+0000 7f081a7fc700 1 -- 172.21.15.151:0/1804285598 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280036f0 con 0x7f082c151300 2022-03-15T05:50:13.816 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.810+0000 7f081a7fc700 1 -- 172.21.15.151:0/1804285598 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0828003870 con 0x7f082c151300 2022-03-15T05:50:13.817 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.810+0000 7f081a7fc700 1 -- 172.21.15.151:0/1804285598 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0828003c30 con 0x7f082c151300 2022-03-15T05:50:13.817 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.810+0000 7f0834357700 1 -- 172.21.15.151:0/1804285598 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f082c16ca50 con 0x7f082c151300 2022-03-15T05:50:13.817 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.810+0000 7f0834357700 1 -- 172.21.15.151:0/1804285598 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f082c16d010 con 0x7f082c151300 2022-03-15T05:50:13.818 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.815+0000 7f0834357700 1 -- 172.21.15.151:0/1804285598 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0810005130 con 0x7f082c151300 2022-03-15T05:50:13.822 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.818+0000 7f081a7fc700 1 -- 172.21.15.151:0/1804285598 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f0828017020 con 0x7f082c151300 2022-03-15T05:50:13.822 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.819+0000 7f081a7fc700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f080c063510 0x7f080c0659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.822 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.820+0000 7f081a7fc700 1 -- 172.21.15.151:0/1804285598 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0828081510 con 0x7f082c151300 2022-03-15T05:50:13.823 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.820+0000 7f08320f3700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f080c063510 0x7f080c0659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.829 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.822+0000 7f081a7fc700 1 -- 172.21.15.151:0/1804285598 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f08280505b0 con 0x7f082c151300 2022-03-15T05:50:13.830 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.828+0000 7f08320f3700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f080c063510 0x7f080c0659c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f081c00b9b0 tx=0x7f081c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.886 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.879+0000 7f44f8b7b700 1 Processor -- start 2022-03-15T05:50:13.887 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.879+0000 7f44f8b7b700 1 -- start start 2022-03-15T05:50:13.887 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.881+0000 7f44f8b7b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f40c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.887 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.881+0000 7f44f8b7b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f44f40c4090 0x7f44f406d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.887 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.881+0000 7f44f8b7b700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f4159780 con 0x7f44f4067c20 2022-03-15T05:50:13.887 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.881+0000 7f44f8b7b700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44f4159cb0 con 0x7f44f40c4090 2022-03-15T05:50:13.888 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.881+0000 7f44f8b7b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f406d8a0 con 0x7f44f4066b40 2022-03-15T05:50:13.888 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.882+0000 7f44f259c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f40c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.888 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.882+0000 7f44f259c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f40c14f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60200/0 (socket says 172.21.15.151:60200) 2022-03-15T05:50:13.888 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.882+0000 7f44f259c700 1 -- 172.21.15.151:0/2860448861 learned_addr learned my addr 172.21.15.151:0/2860448861 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.889 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.882+0000 7f44f1d9b700 1 --2- 172.21.15.151:0/2860448861 >> v2:172.21.15.164:3300/0 conn(0x7f44f40c4090 0x7f44f406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.889 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.882+0000 7f44f2d9d700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f44f4067c20 0x7f44f4066f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33680/0 (socket says 172.21.15.151:33680) 2022-03-15T05:50:13.889 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.883+0000 7f44f159a700 1 -- 172.21.15.151:0/2860448861 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 798203873 0 0) 0x7f44f4159780 con 0x7f44f4067c20 2022-03-15T05:50:13.890 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.884+0000 7f44f159a700 1 -- 172.21.15.151:0/2860448861 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44dc0033f0 con 0x7f44f4067c20 2022-03-15T05:50:13.890 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.884+0000 7f44f259c700 1 -- 172.21.15.151:0/2860448861 >> v2:172.21.15.164:3300/0 conn(0x7f44f40c4090 msgr2=0x7f44f406d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:13.890 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.884+0000 7f44f259c700 1 --2- 172.21.15.151:0/2860448861 >> v2:172.21.15.164:3300/0 conn(0x7f44f40c4090 0x7f44f406d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.891 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.884+0000 7f44f259c700 1 -- 172.21.15.151:0/2860448861 >> v1:172.21.15.164:6789/0 conn(0x7f44f4067c20 legacy=0x7f44f4066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.891 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.884+0000 7f44f259c700 1 -- 172.21.15.151:0/2860448861 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f41599d0 con 0x7f44f4066b40 2022-03-15T05:50:13.891 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.886+0000 7f44f259c700 1 --2- 172.21.15.151:0/2860448861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f40c14f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44e4006fd0 tx=0x7f44e40090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89431320002f3f97 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.892 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.886+0000 7f5c682e9700 1 Processor -- start 2022-03-15T05:50:13.892 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.886+0000 7fbe01aba700 1 Processor -- start 2022-03-15T05:50:13.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.887+0000 7f44f159a700 1 -- 172.21.15.151:0/2860448861 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4011630 con 0x7f44f4066b40 2022-03-15T05:50:13.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.887+0000 7f44f159a700 1 -- 172.21.15.151:0/2860448861 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e4011790 con 0x7f44f4066b40 2022-03-15T05:50:13.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.887+0000 7f44f159a700 1 -- 172.21.15.151:0/2860448861 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4011b50 con 0x7f44f4066b40 2022-03-15T05:50:13.894 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.887+0000 7fbe01aba700 1 -- start start 2022-03-15T05:50:13.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.888+0000 7f44f8b7b700 1 -- 172.21.15.151:0/2860448861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 msgr2=0x7f44f40c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.888+0000 7f44f8b7b700 1 --2- 172.21.15.151:0/2860448861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f40c14f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44e4006fd0 tx=0x7f44e40090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.888+0000 7f44f8b7b700 1 -- 172.21.15.151:0/2860448861 shutdown_connections 2022-03-15T05:50:13.896 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.888+0000 7f44f8b7b700 1 --2- 172.21.15.151:0/2860448861 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f40c14f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.896 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.888+0000 7f44f8b7b700 1 --2- 172.21.15.151:0/2860448861 >> v2:172.21.15.164:3300/0 conn(0x7f44f40c4090 0x7f44f406d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.896 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.888+0000 7f44f8b7b700 1 -- 172.21.15.151:0/2860448861 >> 172.21.15.151:0/2860448861 conn(0x7f44f40c75c0 msgr2=0x7f44f40c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:13.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.887+0000 7f5c682e9700 1 -- start start 2022-03-15T05:50:13.897 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7f5ad2c88700 1 Processor -- start 2022-03-15T05:50:13.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7fbe01aba700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc151300 0x7fbdfc066980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7fbe01aba700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbdfc066ec0 0x7fbdfc151df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.898 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7f5c682e9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60066b40 0x7f5c600c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7f5c682e9700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5c60067c20 0x7f5c6006d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7fbe01aba700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdfc06db00 con 0x7fbdfc0c3d00 2022-03-15T05:50:13.899 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7fbe01aba700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdfc0c0e20 con 0x7fbdfc066ec0 2022-03-15T05:50:13.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7fbe01aba700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc06cef0 con 0x7fbdfc151300 2022-03-15T05:50:13.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7f5c682e9700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c6006ced0 con 0x7f5c600c4090 2022-03-15T05:50:13.900 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7f5c682e9700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c6006e510 con 0x7f5c60067c20 2022-03-15T05:50:13.901 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.889+0000 7f5c682e9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60159cb0 con 0x7f5c60066b40 2022-03-15T05:50:13.901 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.890+0000 7f5c65884700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f5c600c4090 0x7f5c60066f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53218/0 (socket says 172.21.15.151:53218) 2022-03-15T05:50:13.901 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.890+0000 7f5c65884700 1 -- 172.21.15.151:0/2800844932 learned_addr learned my addr 172.21.15.151:0/2800844932 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:13.902 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.890+0000 7fbdfaffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc151300 0x7fbdfc066980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.902 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.890+0000 7f5c66886700 1 --2- 172.21.15.151:0/2800844932 >> v2:172.21.15.151:3300/0 conn(0x7f5c60067c20 0x7f5c6006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.903 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.890+0000 7fbdfaffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc151300 0x7fbdfc066980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60202/0 (socket says 172.21.15.151:60202) 2022-03-15T05:50:13.903 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.890+0000 7fbdfaffd700 1 -- 172.21.15.151:0/349700435 learned_addr learned my addr 172.21.15.151:0/349700435 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.903 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.891+0000 7fbdfbfff700 1 --2- 172.21.15.151:0/349700435 >> v2:172.21.15.151:3300/0 conn(0x7fbdfc066ec0 0x7fbdfc151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.904 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.892+0000 7f5c66886700 1 -- 172.21.15.151:0/2800844932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60066b40 msgr2=0x7f5c600c14f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2022-03-15T05:50:13.904 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.892+0000 7f5c66886700 1 --2- 172.21.15.151:0/2800844932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60066b40 0x7f5c600c14f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.905 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.892+0000 7f5c66886700 1 -- 172.21.15.151:0/2800844932 >> v1:172.21.15.151:6789/0 conn(0x7f5c600c4090 legacy=0x7f5c60066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.905 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.892+0000 7f5c66886700 1 -- 172.21.15.151:0/2800844932 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c6006d8a0 con 0x7f5c60067c20 2022-03-15T05:50:13.906 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.891+0000 7f5ad2c88700 1 -- start start 2022-03-15T05:50:13.906 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.892+0000 7f5c66886700 1 --2- 172.21.15.151:0/2800844932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c60067c20 0x7f5c6006d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009760 tx=0x7f5c50009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3c16ed731bf1db server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.907 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.890+0000 7f44f8b7b700 1 -- 172.21.15.151:0/2860448861 shutdown_connections 2022-03-15T05:50:13.908 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.893+0000 7f44f8b7b700 1 -- 172.21.15.151:0/2860448861 wait complete. 2022-03-15T05:50:13.908 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.893+0000 7fbdfaffd700 1 -- 172.21.15.151:0/349700435 >> v2:172.21.15.151:3300/0 conn(0x7fbdfc066ec0 msgr2=0x7fbdfc151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:13.909 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.893+0000 7fbdfaffd700 1 --2- 172.21.15.151:0/349700435 >> v2:172.21.15.151:3300/0 conn(0x7fbdfc066ec0 0x7fbdfc151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.909 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.893+0000 7fbdfaffd700 1 -- 172.21.15.151:0/349700435 >> v1:172.21.15.151:6789/0 conn(0x7fbdfc0c3d00 legacy=0x7fbdfc0c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.893+0000 7fbdfaffd700 1 -- 172.21.15.151:0/349700435 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdfc06d1d0 con 0x7fbdfc151300 2022-03-15T05:50:13.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.893+0000 7fbdfaffd700 1 --2- 172.21.15.151:0/349700435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc151300 0x7fbdfc066980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbdec006fd0 tx=0x7fbdec0090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13a5bf537ed15e71 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.893+0000 7f5ad2c88700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5acc0c3d00 0x7f5acc151300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.910 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.893+0000 7f5ad2c88700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5acc0c0710 0x7f5acc151df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.894+0000 7f14b93f2700 1 Processor -- start 2022-03-15T05:50:13.911 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.893+0000 7f5ad2c88700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5acc06db00 con 0x7f5acc0c0b40 2022-03-15T05:50:13.912 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.894+0000 7f5ad2c88700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5acc151840 con 0x7f5acc0c3d00 2022-03-15T05:50:13.912 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.894+0000 7f5ad2c88700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc06cef0 con 0x7f5acc0c0710 2022-03-15T05:50:13.912 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f5c65083700 1 -- 172.21.15.151:0/2800844932 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50011630 con 0x7f5c60067c20 2022-03-15T05:50:13.913 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f5c65083700 1 -- 172.21.15.151:0/2800844932 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c50011790 con 0x7f5c60067c20 2022-03-15T05:50:13.913 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f5c65083700 1 -- 172.21.15.151:0/2800844932 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c50011b10 con 0x7f5c60067c20 2022-03-15T05:50:13.913 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.894+0000 7fbdfa7fc700 1 -- 172.21.15.151:0/349700435 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec004030 con 0x7fbdfc151300 2022-03-15T05:50:13.914 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.894+0000 7fbdfa7fc700 1 -- 172.21.15.151:0/349700435 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec0041d0 con 0x7fbdfc151300 2022-03-15T05:50:13.914 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.894+0000 7fbdfa7fc700 1 -- 172.21.15.151:0/349700435 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec011630 con 0x7fbdfc151300 2022-03-15T05:50:13.915 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7fbe01aba700 1 -- 172.21.15.151:0/349700435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc151300 msgr2=0x7fbdfc066980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.915 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7fbe01aba700 1 --2- 172.21.15.151:0/349700435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc151300 0x7fbdfc066980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbdec006fd0 tx=0x7fbdec0090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.916 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.894+0000 7f5ad0a24700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5acc0c3d00 0x7f5acc151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.917 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f5ad0a24700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5acc0c3d00 0x7f5acc151300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60096/0 (socket says 172.21.15.151:60096) 2022-03-15T05:50:13.917 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f5ad0a24700 1 -- 172.21.15.151:0/2966271631 learned_addr learned my addr 172.21.15.151:0/2966271631 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.917 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f5acbfff700 1 --2- 172.21.15.151:0/2966271631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5acc0c0710 0x7f5acc151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.917 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f5ad0a24700 1 -- 172.21.15.151:0/2966271631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5acc0c0710 msgr2=0x7f5acc151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:13.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f5ad0a24700 1 --2- 172.21.15.151:0/2966271631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5acc0c0710 0x7f5acc151df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f5ad0a24700 1 -- 172.21.15.151:0/2966271631 >> v1:172.21.15.151:6789/0 conn(0x7f5acc0c0b40 legacy=0x7f5acc153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f5ad0a24700 1 -- 172.21.15.151:0/2966271631 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc06d1d0 con 0x7f5acc0c3d00 2022-03-15T05:50:13.918 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.895+0000 7f44f8b7b700 1 Processor -- start 2022-03-15T05:50:13.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7f44f8b7b700 1 -- start start 2022-03-15T05:50:13.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7fbe01aba700 1 -- 172.21.15.151:0/349700435 shutdown_connections 2022-03-15T05:50:13.919 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7fbe01aba700 1 --2- 172.21.15.151:0/349700435 >> v2:172.21.15.151:3300/0 conn(0x7fbdfc066ec0 0x7fbdfc151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.920 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7fbe01aba700 1 --2- 172.21.15.151:0/349700435 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc151300 0x7fbdfc066980 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.920 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7fbe01aba700 1 -- 172.21.15.151:0/349700435 >> 172.21.15.151:0/349700435 conn(0x7fbdfc0c75c0 msgr2=0x7fbdfc0c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:13.920 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7f5ad0a24700 1 --2- 172.21.15.151:0/2966271631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 0x7f5acc151300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8006fd0 tx=0x7f5ab80090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b76f41bcf6abf8 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.921 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7f5c682e9700 1 -- 172.21.15.151:0/2800844932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c60067c20 msgr2=0x7f5c6006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.922 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7f5c682e9700 1 --2- 172.21.15.151:0/2800844932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c60067c20 0x7f5c6006d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c50009760 tx=0x7f5c50009060 comp rx=0 tx=0).stop 2022-03-15T05:50:13.922 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7f5c682e9700 1 -- 172.21.15.151:0/2800844932 shutdown_connections 2022-03-15T05:50:13.923 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7f5c682e9700 1 --2- 172.21.15.151:0/2800844932 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c60067c20 0x7f5c6006d360 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.923 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7f5c682e9700 1 --2- 172.21.15.151:0/2800844932 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60066b40 0x7f5c600c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.896+0000 7f5c682e9700 1 -- 172.21.15.151:0/2800844932 >> 172.21.15.151:0/2800844932 conn(0x7f5c600c75c0 msgr2=0x7f5c600c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:13.924 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f44f8b7b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f4139920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.925 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f44f8b7b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f4067c20 0x7f44f40b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.925 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f44f8b7b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44f40c4090 0x7f44f40c5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.926 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f44f8b7b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40b9690 con 0x7f44f4067c20 2022-03-15T05:50:13.926 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f44f8b7b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40b4380 con 0x7f44f40c4090 2022-03-15T05:50:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f44f8b7b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f40b4660 con 0x7f44f4066b40 2022-03-15T05:50:13.927 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.898+0000 7f44f259c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f4139920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.928 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.898+0000 7f44f259c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f4139920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60210/0 (socket says 172.21.15.151:60210) 2022-03-15T05:50:13.928 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.898+0000 7f44f259c700 1 -- 172.21.15.151:0/415491359 learned_addr learned my addr 172.21.15.151:0/415491359 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.929 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.898+0000 7f44f259c700 1 -- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44f40c4090 msgr2=0x7f44f40c5f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-15T05:50:13.929 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.898+0000 7f44f259c700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44f40c4090 0x7f44f40c5f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.930 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.898+0000 7f44f259c700 1 -- 172.21.15.151:0/415491359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f4067c20 msgr2=0x7f44f40b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.930 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.898+0000 7f44f259c700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f4067c20 0x7f44f40b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.930 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.898+0000 7f44f259c700 1 -- 172.21.15.151:0/415491359 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e4009370 con 0x7f44f4066b40 2022-03-15T05:50:13.931 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f44f259c700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f4139920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44f406d9e0 tx=0x7f44e4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f5c682e9700 1 -- 172.21.15.151:0/2800844932 shutdown_connections 2022-03-15T05:50:13.932 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f5c682e9700 1 -- 172.21.15.151:0/2800844932 wait complete. 2022-03-15T05:50:13.933 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.900+0000 7f5c682e9700 1 Processor -- start 2022-03-15T05:50:13.933 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.900+0000 7f5c682e9700 1 -- start start 2022-03-15T05:50:13.934 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f14b93f2700 1 -- start start 2022-03-15T05:50:13.934 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f14b93f2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f14b4066b40 0x7f14b40c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f14b93f2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b40c4090 0x7f14b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.935 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f14b93f2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14b406ced0 con 0x7f14b4067c20 2022-03-15T05:50:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f14b93f2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14b406e510 con 0x7f14b4066b40 2022-03-15T05:50:13.936 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f14b93f2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4159cb0 con 0x7f14b40c4090 2022-03-15T05:50:13.937 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f14b27fc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b40c4090 0x7f14b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.937 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f14b27fc700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b40c4090 0x7f14b406d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60212/0 (socket says 172.21.15.151:60212) 2022-03-15T05:50:13.937 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f14b27fc700 1 -- 172.21.15.151:0/2902504787 learned_addr learned my addr 172.21.15.151:0/2902504787 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.938 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f5acb7fe700 1 -- 172.21.15.151:0/2966271631 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8004030 con 0x7f5acc0c3d00 2022-03-15T05:50:13.939 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f5acb7fe700 1 -- 172.21.15.151:0/2966271631 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab8004190 con 0x7f5acc0c3d00 2022-03-15T05:50:13.939 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.897+0000 7f5acb7fe700 1 -- 172.21.15.151:0/2966271631 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab8011630 con 0x7f5acc0c3d00 2022-03-15T05:50:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.898+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2966271631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 msgr2=0x7f5acc151300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.940 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.898+0000 7f5ad2c88700 1 --2- 172.21.15.151:0/2966271631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 0x7f5acc151300 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8006fd0 tx=0x7f5ab80090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.941 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2966271631 shutdown_connections 2022-03-15T05:50:13.941 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f5ad2c88700 1 --2- 172.21.15.151:0/2966271631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 0x7f5acc151300 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.941 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f5ad2c88700 1 --2- 172.21.15.151:0/2966271631 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5acc0c0710 0x7f5acc151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.942 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2966271631 >> 172.21.15.151:0/2966271631 conn(0x7f5acc0c75c0 msgr2=0x7f5acc0c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:13.942 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2966271631 shutdown_connections 2022-03-15T05:50:13.943 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.900+0000 7fbe01aba700 1 -- 172.21.15.151:0/349700435 shutdown_connections 2022-03-15T05:50:13.944 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.901+0000 7f14b27fc700 1 -- 172.21.15.151:0/2902504787 >> v2:172.21.15.151:3300/0 conn(0x7f14b4066b40 msgr2=0x7f14b40c14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.901+0000 7f14b27fc700 1 --2- 172.21.15.151:0/2902504787 >> v2:172.21.15.151:3300/0 conn(0x7f14b4066b40 0x7f14b40c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.901+0000 7f14b27fc700 1 -- 172.21.15.151:0/2902504787 >> v1:172.21.15.151:6789/0 conn(0x7f14b4067c20 legacy=0x7f14b4066f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:13.945 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.901+0000 7f14b27fc700 1 -- 172.21.15.151:0/2902504787 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b406d8a0 con 0x7f14b40c4090 2022-03-15T05:50:13.946 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.901+0000 7fbf0bdd4700 1 Processor -- start 2022-03-15T05:50:13.947 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.901+0000 7f14b27fc700 1 --2- 172.21.15.151:0/2902504787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b40c4090 0x7f14b406d360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f14a8006fd0 tx=0x7f14a80090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b30d36ff8512492 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f44e27fc700 1 -- 172.21.15.151:0/415491359 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e40036f0 con 0x7f44f4066b40 2022-03-15T05:50:13.948 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.900+0000 7f44e27fc700 1 -- 172.21.15.151:0/415491359 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e4003850 con 0x7f44f4066b40 2022-03-15T05:50:13.949 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.900+0000 7f44e27fc700 1 -- 172.21.15.151:0/415491359 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4003bd0 con 0x7f44f4066b40 2022-03-15T05:50:13.949 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.901+0000 7f44f8b7b700 1 -- 172.21.15.151:0/415491359 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f40b4940 con 0x7f44f4066b40 2022-03-15T05:50:13.950 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.901+0000 7f44f8b7b700 1 -- 172.21.15.151:0/415491359 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f40b4f00 con 0x7f44f4066b40 2022-03-15T05:50:13.950 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f44f8b7b700 1 -- 172.21.15.151:0/415491359 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f40704b0 con 0x7f44f4066b40 2022-03-15T05:50:13.951 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.901+0000 7f5c682e9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c60066b40 0x7f5c60174b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f5c682e9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60067c20 0x7f5c600c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f5c682e9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c600c4090 0x7f5c60152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.952 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f5c682e9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6015a3a0 con 0x7f5c600c4090 2022-03-15T05:50:13.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f5c682e9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60159e70 con 0x7f5c60066b40 2022-03-15T05:50:13.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f5c682e9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c60174700 con 0x7f5c60067c20 2022-03-15T05:50:13.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f5c65884700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60067c20 0x7f5c600c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f5c65884700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60067c20 0x7f5c600c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60214/0 (socket says 172.21.15.151:60214) 2022-03-15T05:50:13.955 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f5c65884700 1 -- 172.21.15.151:0/2662374304 learned_addr learned my addr 172.21.15.151:0/2662374304 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.901+0000 7fbf0bdd4700 1 -- start start 2022-03-15T05:50:13.956 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.899+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2966271631 wait complete. 2022-03-15T05:50:13.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f5ad2c88700 1 Processor -- start 2022-03-15T05:50:13.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.903+0000 7f5c65884700 1 -- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c60066b40 msgr2=0x7f5c60174b90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-15T05:50:13.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.903+0000 7f5c65884700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c60066b40 0x7f5c60174b90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.903+0000 7f5c65884700 1 -- 172.21.15.151:0/2662374304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c600c4090 msgr2=0x7f5c60152190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.960 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.903+0000 7f5c65884700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c600c4090 0x7f5c60152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.960 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.903+0000 7f5c65884700 1 -- 172.21.15.151:0/2662374304 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c500092a0 con 0x7f5c60067c20 2022-03-15T05:50:13.964 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.903+0000 7f5c65884700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60067c20 0x7f5c600c5800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800c870 tx=0x7f5c580015e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.965 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.903+0000 7fbf0bdd4700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7fbf04066b40 0x7fbf040c14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.966 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7fbf0bdd4700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf0406ced0 con 0x7fbf040c4090 2022-03-15T05:50:13.966 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7fbf0bdd4700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf04159740 con 0x7fbf04067c20 2022-03-15T05:50:13.967 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7fbf0bdd4700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf0406e510 con 0x7fbf04066b40 2022-03-15T05:50:13.968 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7f14b1ffb700 1 -- 172.21.15.151:0/2902504787 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8011630 con 0x7f14b40c4090 2022-03-15T05:50:13.968 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7f14b1ffb700 1 -- 172.21.15.151:0/2902504787 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a8011790 con 0x7f14b40c4090 2022-03-15T05:50:13.968 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7f14b1ffb700 1 -- 172.21.15.151:0/2902504787 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a8011b50 con 0x7f14b40c4090 2022-03-15T05:50:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7fbf0a371700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7fbf04067c20 0x7fbf04155e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33682/0 (socket says 172.21.15.151:33682) 2022-03-15T05:50:13.970 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7fbf0a371700 1 -- 172.21.15.151:0/3202208865 learned_addr learned my addr 172.21.15.151:0/3202208865 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:13.971 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7fbf09b70700 1 --2- 172.21.15.151:0/3202208865 >> v2:172.21.15.164:3300/0 conn(0x7fbf04066b40 0x7fbf040c14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.971 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.902+0000 7f5ad2c88700 1 -- start start 2022-03-15T05:50:13.972 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7f5ad2c88700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5acc0c0710 0x7f5acc1464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.972 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7f5ad2c88700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5acc0c0b40 0x7f5acc0c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7f5ad2c88700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 0x7f5acc1404c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.973 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7f5ad2c88700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc16c6e0 con 0x7f5acc0c3d00 2022-03-15T05:50:13.974 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7f5ad2c88700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc145640 con 0x7f5acc0c0710 2022-03-15T05:50:13.974 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7f5ad2c88700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5acc145900 con 0x7f5acc0c0b40 2022-03-15T05:50:13.975 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7fbf08b6e700 1 -- 172.21.15.151:0/3202208865 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1680366297 0 0) 0x7fbf04159740 con 0x7fbf04067c20 2022-03-15T05:50:13.975 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7fbf08b6e700 1 -- 172.21.15.151:0/3202208865 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeec0033f0 con 0x7fbf04067c20 2022-03-15T05:50:13.976 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7f44e27fc700 1 -- 172.21.15.151:0/415491359 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f44e400f050 con 0x7f44f4066b40 2022-03-15T05:50:13.977 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7fbf09b70700 1 -- 172.21.15.151:0/3202208865 >> v1:172.21.15.164:6789/0 conn(0x7fbf04067c20 legacy=0x7fbf04155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.977 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7fbf09b70700 1 -- 172.21.15.151:0/3202208865 >> v1:172.21.15.151:6789/0 conn(0x7fbf040c4090 legacy=0x7fbf04066f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2022-03-15T05:50:13.978 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7fbf09b70700 1 -- 172.21.15.151:0/3202208865 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf041599d0 con 0x7fbf04066b40 2022-03-15T05:50:13.979 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7f5ad1225700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 0x7f5acc1404c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.980 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7fbf09b70700 1 --2- 172.21.15.151:0/3202208865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf04066b40 0x7fbf040c14f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009760 tx=0x7fbef4009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfbf0f1451f53f03 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.980 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7f5ad1225700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 0x7f5acc1404c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60104/0 (socket says 172.21.15.151:60104) 2022-03-15T05:50:13.981 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7f5ad1225700 1 -- 172.21.15.151:0/2990323414 learned_addr learned my addr 172.21.15.151:0/2990323414 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.982 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.904+0000 7fbe01aba700 1 -- 172.21.15.151:0/349700435 wait complete. 2022-03-15T05:50:13.983 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7fbf08b6e700 1 -- 172.21.15.151:0/3202208865 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4004030 con 0x7fbf04066b40 2022-03-15T05:50:13.983 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7fbf08b6e700 1 -- 172.21.15.151:0/3202208865 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef4004190 con 0x7fbf04066b40 2022-03-15T05:50:13.983 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7fbf08b6e700 1 -- 172.21.15.151:0/3202208865 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef4011630 con 0x7fbf04066b40 2022-03-15T05:50:13.984 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7f44e27fc700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f44d8063510 0x7f44d80659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.984 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7f44e27fc700 1 -- 172.21.15.151:0/415491359 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f44e40817d0 con 0x7f44f4066b40 2022-03-15T05:50:13.985 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7f44f1d9b700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f44d8063510 0x7f44d80659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.985 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7f44e27fc700 1 -- 172.21.15.151:0/415491359 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f44e40507f0 con 0x7f44f4066b40 2022-03-15T05:50:13.985 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7f5c4e7fc700 1 -- 172.21.15.151:0/2662374304 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58005d30 con 0x7f5c60067c20 2022-03-15T05:50:13.985 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7f5c4e7fc700 1 -- 172.21.15.151:0/2662374304 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c58005e90 con 0x7f5c60067c20 2022-03-15T05:50:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7f5c4e7fc700 1 -- 172.21.15.151:0/2662374304 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58004c40 con 0x7f5c60067c20 2022-03-15T05:50:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.909+0000 7f5c682e9700 1 -- 172.21.15.151:0/2662374304 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c601743d0 con 0x7f5c60067c20 2022-03-15T05:50:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.909+0000 7f5c682e9700 1 -- 172.21.15.151:0/2662374304 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c601716c0 con 0x7f5c60067c20 2022-03-15T05:50:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7f14b93f2700 1 -- 172.21.15.151:0/2902504787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b40c4090 msgr2=0x7f14b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.905+0000 7f14b93f2700 1 --2- 172.21.15.151:0/2902504787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b40c4090 0x7f14b406d360 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f14a8006fd0 tx=0x7f14a80090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7f14b93f2700 1 -- 172.21.15.151:0/2902504787 shutdown_connections 2022-03-15T05:50:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7f14b93f2700 1 --2- 172.21.15.151:0/2902504787 >> v2:172.21.15.151:3300/0 conn(0x7f14b4066b40 0x7f14b40c14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7f14b93f2700 1 --2- 172.21.15.151:0/2902504787 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b40c4090 0x7f14b406d360 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f14a8006fd0 tx=0x7f14a80090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.906+0000 7f14b93f2700 1 -- 172.21.15.151:0/2902504787 >> 172.21.15.151:0/2902504787 conn(0x7f14b40c75c0 msgr2=0x7f14b40c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.910+0000 7f14b93f2700 1 -- 172.21.15.151:0/2902504787 shutdown_connections 2022-03-15T05:50:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7fbe01aba700 1 Processor -- start 2022-03-15T05:50:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7fbe01aba700 1 -- start start 2022-03-15T05:50:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.909+0000 7fbe01aba700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdfc066ec0 0x7fbdfc14d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.909+0000 7fbe01aba700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc0c3d00 0x7fbdfc0bc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.909+0000 7fbe01aba700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdfc151300 0x7fbdfc1625c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.990 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.909+0000 7fbe01aba700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc169810 con 0x7fbdfc151300 2022-03-15T05:50:13.990 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.909+0000 7fbe01aba700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc154510 con 0x7fbdfc066ec0 2022-03-15T05:50:13.990 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.909+0000 7fbe01aba700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdfc14d8a0 con 0x7fbdfc0c3d00 2022-03-15T05:50:13.990 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.910+0000 7fbdfaffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc0c3d00 0x7fbdfc0bc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.910+0000 7fbdfaffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc0c3d00 0x7fbdfc0bc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60218/0 (socket says 172.21.15.151:60218) 2022-03-15T05:50:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.910+0000 7fbdfaffd700 1 -- 172.21.15.151:0/2751879538 learned_addr learned my addr 172.21.15.151:0/2751879538 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.911+0000 7fbdfb7fe700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdfc066ec0 0x7fbdfc14d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.911+0000 7fbdfaffd700 1 -- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdfc066ec0 msgr2=0x7fbdfc14d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.911+0000 7fbdfaffd700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdfc066ec0 0x7fbdfc14d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.992 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.911+0000 7fbdfaffd700 1 -- 172.21.15.151:0/2751879538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdfc151300 msgr2=0x7fbdfc1625c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.992 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.911+0000 7fbdfaffd700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdfc151300 0x7fbdfc1625c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.992 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.911+0000 7fbdfaffd700 1 -- 172.21.15.151:0/2751879538 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec009370 con 0x7fbdfc0c3d00 2022-03-15T05:50:13.992 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.912+0000 7fbdfaffd700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc0c3d00 0x7fbdfc0bc910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009130 tx=0x7fbdec016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.993 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/3202208865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf04066b40 msgr2=0x7fbf040c14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:13.993 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7fbf0bdd4700 1 --2- 172.21.15.151:0/3202208865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf04066b40 0x7fbf040c14f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009760 tx=0x7fbef4009060 comp rx=0 tx=0).stop 2022-03-15T05:50:13.993 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/3202208865 shutdown_connections 2022-03-15T05:50:13.993 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7fbf0bdd4700 1 --2- 172.21.15.151:0/3202208865 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf04066b40 0x7fbf040c14f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/3202208865 >> 172.21.15.151:0/3202208865 conn(0x7fbf040c75c0 msgr2=0x7fbf040c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.909+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/3202208865 shutdown_connections 2022-03-15T05:50:13.994 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7f5ad1225700 1 -- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5acc0c0b40 msgr2=0x7f5acc0c59a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-15T05:50:13.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7f5ad1225700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5acc0c0b40 0x7f5acc0c59a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7f5ad1225700 1 -- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5acc0c0710 msgr2=0x7f5acc1464a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-15T05:50:13.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7f5ad1225700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5acc0c0710 0x7f5acc1464a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:13.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7f5ad1225700 1 -- 172.21.15.151:0/2990323414 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ab8009370 con 0x7f5acc0c3d00 2022-03-15T05:50:13.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.907+0000 7f5ad1225700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 0x7f5acc1404c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400c7c0 tx=0x7f5ac40014c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7f5ac8ff9700 1 -- 172.21.15.151:0/2990323414 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4003840 con 0x7f5acc0c3d00 2022-03-15T05:50:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7f5ac8ff9700 1 -- 172.21.15.151:0/2990323414 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac40039c0 con 0x7f5acc0c3d00 2022-03-15T05:50:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7f5ac8ff9700 1 -- 172.21.15.151:0/2990323414 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4003d80 con 0x7f5acc0c3d00 2022-03-15T05:50:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2990323414 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5acc16bdb0 con 0x7f5acc0c3d00 2022-03-15T05:50:13.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.908+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2990323414 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5acc16c370 con 0x7f5acc0c3d00 2022-03-15T05:50:13.997 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.910+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2990323414 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5acc04b760 con 0x7f5acc0c3d00 2022-03-15T05:50:13.997 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.910+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/3202208865 wait complete. 2022-03-15T05:50:13.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.913+0000 7fbf0bdd4700 1 Processor -- start 2022-03-15T05:50:13.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.913+0000 7f5ac8ff9700 1 -- 172.21.15.151:0/2990323414 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f5ac4010050 con 0x7f5acc0c3d00 2022-03-15T05:50:13.999 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.911+0000 7f5c682e9700 1 -- 172.21.15.151:0/2662374304 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c600704b0 con 0x7f5c60067c20 2022-03-15T05:50:13.999 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.913+0000 7f5c4e7fc700 1 -- 172.21.15.151:0/2662374304 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f5c5801a030 con 0x7f5c60067c20 2022-03-15T05:50:13.999 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.915+0000 7f5c4e7fc700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5c40063490 0x7f5c40065940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:13.999 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.915+0000 7f5c4e7fc700 1 -- 172.21.15.151:0/2662374304 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5c5807f100 con 0x7f5c60067c20 2022-03-15T05:50:14.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.916+0000 7f5c66085700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5c40063490 0x7f5c40065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.914+0000 7f14b93f2700 1 -- 172.21.15.151:0/2902504787 wait complete. 2022-03-15T05:50:14.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.917+0000 7f14b93f2700 1 Processor -- start 2022-03-15T05:50:14.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.917+0000 7f14b93f2700 1 -- start start 2022-03-15T05:50:14.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.918+0000 7f14b93f2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b4066b40 0x7f14b41469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7f14b93f2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b4067c20 0x7f14b413a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7f14b93f2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14b40b6c40 0x7f14b413a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7f14b93f2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40b50c0 con 0x7f14b4067c20 2022-03-15T05:50:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7f14b93f2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40c09f0 con 0x7f14b40b6c40 2022-03-15T05:50:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7f14b93f2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14b40b65e0 con 0x7f14b4066b40 2022-03-15T05:50:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7f14b2ffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b4066b40 0x7f14b41469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7f14b2ffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b4066b40 0x7f14b41469e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60222/0 (socket says 172.21.15.151:60222) 2022-03-15T05:50:14.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7f14b2ffd700 1 -- 172.21.15.151:0/1326960824 learned_addr learned my addr 172.21.15.151:0/1326960824 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:14.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.920+0000 7f14b2ffd700 1 -- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14b40b6c40 msgr2=0x7f14b413a930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2022-03-15T05:50:14.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.920+0000 7f14b2ffd700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14b40b6c40 0x7f14b413a930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.920+0000 7f14b2ffd700 1 -- 172.21.15.151:0/1326960824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b4067c20 msgr2=0x7f14b413a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.920+0000 7f14b2ffd700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b4067c20 0x7f14b413a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.920+0000 7f14b2ffd700 1 -- 172.21.15.151:0/1326960824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14a8009370 con 0x7f14b4066b40 2022-03-15T05:50:14.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.920+0000 7f14b2ffd700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b4066b40 0x7f14b41469e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00bc30 tx=0x7f14ac009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.917+0000 7fbde37fe700 1 -- 172.21.15.151:0/2751879538 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec0036f0 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.917+0000 7fbde37fe700 1 -- 172.21.15.151:0/2751879538 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdec003870 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.917+0000 7fbde37fe700 1 -- 172.21.15.151:0/2751879538 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdec003c30 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.917+0000 7fbe01aba700 1 -- 172.21.15.151:0/2751879538 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdfc14ced0 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.917+0000 7fbe01aba700 1 -- 172.21.15.151:0/2751879538 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdfc1692c0 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.914+0000 7fbf0bdd4700 1 -- start start 2022-03-15T05:50:14.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.915+0000 7fbf0bdd4700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf04066b40 0x7fbf04154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.915+0000 7fbf0bdd4700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf04067c20 0x7fbf040c0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.915+0000 7fbf0bdd4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf0415ef70 0x7fbf04152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.915+0000 7fbf0bdd4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf04159cb0 con 0x7fbf0415ef70 2022-03-15T05:50:14.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.915+0000 7fbf0bdd4700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf0415b190 con 0x7fbf04067c20 2022-03-15T05:50:14.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.916+0000 7fbf0bdd4700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf041693e0 con 0x7fbf04066b40 2022-03-15T05:50:14.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.916+0000 7fbf0a371700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf0415ef70 0x7fbf04152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.916+0000 7fbf0a371700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf0415ef70 0x7fbf04152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60108/0 (socket says 172.21.15.151:60108) 2022-03-15T05:50:14.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.916+0000 7fbf0a371700 1 -- 172.21.15.151:0/181315283 learned_addr learned my addr 172.21.15.151:0/181315283 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:14.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.917+0000 7fbf09b70700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf04066b40 0x7fbf04154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.917+0000 7fbf0936f700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf04067c20 0x7fbf040c0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7fbf0a371700 1 -- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf04066b40 msgr2=0x7fbf04154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7fbf0a371700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf04066b40 0x7fbf04154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7fbf0a371700 1 -- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf04067c20 msgr2=0x7fbf040c0710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7fbf0a371700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf04067c20 0x7fbf040c0710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.919+0000 7fbf0a371700 1 -- 172.21.15.151:0/181315283 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef40092a0 con 0x7fbf0415ef70 2022-03-15T05:50:14.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.920+0000 7fbf0a371700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf0415ef70 0x7fbf04152080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c7c0 tx=0x7fbefc007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.921+0000 7f5ac8ff9700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5ab4063510 0x7f5ab40659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.921+0000 7f5ac8ff9700 1 -- 172.21.15.151:0/2990323414 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5ac40801b0 con 0x7f5acc0c3d00 2022-03-15T05:50:14.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.921+0000 7f149affd700 1 -- 172.21.15.151:0/1326960824 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0092e0 con 0x7f14b4066b40 2022-03-15T05:50:14.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.921+0000 7f149affd700 1 -- 172.21.15.151:0/1326960824 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac00c7a0 con 0x7f14b4066b40 2022-03-15T05:50:14.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.921+0000 7f149affd700 1 -- 172.21.15.151:0/1326960824 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac00cb60 con 0x7f14b4066b40 2022-03-15T05:50:14.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.922+0000 7f5ac8ff9700 1 -- 172.21.15.151:0/2990323414 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f5ac40805a0 con 0x7f5acc0c3d00 2022-03-15T05:50:14.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.922+0000 7f5ad0a24700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5ab4063510 0x7f5ab40659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.910+0000 7f44f1d9b700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f44d8063510 0x7f44d80659c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f44f406c4d0 tx=0x7f44ec00b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.922+0000 7f14b93f2700 1 -- 172.21.15.151:0/1326960824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b40b68c0 con 0x7f14b4066b40 2022-03-15T05:50:14.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.922+0000 7f14b93f2700 1 -- 172.21.15.151:0/1326960824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b406ee50 con 0x7f14b4066b40 2022-03-15T05:50:14.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.920+0000 7fbde37fe700 1 -- 172.21.15.151:0/2751879538 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fbdec02b030 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.920+0000 7fbe01aba700 1 -- 172.21.15.151:0/2751879538 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbdd8005130 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.922+0000 7fbde37fe700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbddc063540 0x7fbddc0659f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.922+0000 7fbde37fe700 1 -- 172.21.15.151:0/2751879538 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbdec0815a0 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.923+0000 7fbdfb7fe700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbddc063540 0x7fbddc0659f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.923+0000 7fbef1ffb700 1 -- 172.21.15.151:0/181315283 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc005d30 con 0x7fbf0415ef70 2022-03-15T05:50:14.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.923+0000 7fbef1ffb700 1 -- 172.21.15.151:0/181315283 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbefc0070d0 con 0x7fbf0415ef70 2022-03-15T05:50:14.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.923+0000 7fbef1ffb700 1 -- 172.21.15.151:0/181315283 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbefc007490 con 0x7fbf0415ef70 2022-03-15T05:50:14.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.923+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/181315283 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf0415a6f0 con 0x7fbf0415ef70 2022-03-15T05:50:14.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.923+0000 7f5c4e7fc700 1 -- 172.21.15.151:0/2662374304 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f5c5804e250 con 0x7f5c60067c20 2022-03-15T05:50:14.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.924+0000 7f5c66085700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5c40063490 0x7f5c40065940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009520 tx=0x7f5c5c006a40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.924+0000 7f5ad0a24700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5ab4063510 0x7f5ab40659c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8006fd0 tx=0x7f5ab8016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.924+0000 7f14b93f2700 1 -- 172.21.15.151:0/1326960824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b40704b0 con 0x7f14b4066b40 2022-03-15T05:50:14.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.924+0000 7fbdfb7fe700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbddc063540 0x7fbddc0659f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0001860 tx=0x7fbdf0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.923+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/181315283 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf0415a130 con 0x7fbf0415ef70 2022-03-15T05:50:14.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.926+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/181315283 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf04169590 con 0x7fbf0415ef70 2022-03-15T05:50:14.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.927+0000 7fbef1ffb700 1 -- 172.21.15.151:0/181315283 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fbefc019030 con 0x7fbf0415ef70 2022-03-15T05:50:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.929+0000 7fbde37fe700 1 -- 172.21.15.151:0/2751879538 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fbdec0505c0 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.928+0000 7fbef1ffb700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbee40634c0 0x7fbee4065970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.928+0000 7fbef1ffb700 1 -- 172.21.15.151:0/181315283 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbefc07eff0 con 0x7fbf0415ef70 2022-03-15T05:50:14.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.927+0000 7f149affd700 1 -- 172.21.15.151:0/1326960824 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f14ac007400 con 0x7f14b4066b40 2022-03-15T05:50:14.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.928+0000 7f149affd700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1494063510 0x7f14940659c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.928+0000 7f149affd700 1 -- 172.21.15.151:0/1326960824 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f14ac07f9b0 con 0x7f14b4066b40 2022-03-15T05:50:14.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.929+0000 7f14b27fc700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1494063510 0x7f14940659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.930+0000 7f14b27fc700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1494063510 0x7f14940659c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f14a8006fd0 tx=0x7f14a8017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.935+0000 7f149affd700 1 -- 172.21.15.151:0/1326960824 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f14ac04e9f0 con 0x7f14b4066b40 2022-03-15T05:50:14.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.935+0000 7fbf09b70700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbee40634c0 0x7fbee4065970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.939+0000 7fbef1ffb700 1 -- 172.21.15.151:0/181315283 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fbf04169590 con 0x7fbf0415ef70 2022-03-15T05:50:14.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:13.955+0000 7fbf09b70700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbee40634c0 0x7fbee4065970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbef4006f70 tx=0x7fbef4016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.188 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.186+0000 7f3742f17700 1 -- 172.21.15.151:0/918383966 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f37180053e0 con 0x7f373c06edc0 2022-03-15T05:50:14.189 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.187+0000 7f3738ff9700 1 -- 172.21.15.151:0/918383966 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3734016020 con 0x7f373c06edc0 2022-03-15T05:50:14.192 INFO:teuthology.orchestra.run.smithi151.stdout:60129542153 2022-03-15T05:50:14.194 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.192+0000 7f3742f17700 1 -- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f371c063510 msgr2=0x7f371c0659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.194 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.192+0000 7f3742f17700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f371c063510 0x7f371c0659c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f372c006fd0 tx=0x7f372c018000 comp rx=0 tx=0).stop 2022-03-15T05:50:14.194 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.192+0000 7f3742f17700 1 -- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c06edc0 msgr2=0x7f373c15d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.195 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.192+0000 7f3742f17700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c06edc0 0x7f373c15d570 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f373400c840 tx=0x7f3734003b90 comp rx=0 tx=0).stop 2022-03-15T05:50:14.195 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.193+0000 7f3742f17700 1 -- 172.21.15.151:0/918383966 shutdown_connections 2022-03-15T05:50:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.193+0000 7f3742f17700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f371c063510 0x7f371c0659c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.193+0000 7f3742f17700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f373c0c2a40 0x7f373c15a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.193+0000 7f3742f17700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f373c066b40 0x7f373c0c13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.196 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.193+0000 7f3742f17700 1 --2- 172.21.15.151:0/918383966 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f373c06edc0 0x7f373c15d570 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.193+0000 7f3742f17700 1 -- 172.21.15.151:0/918383966 >> 172.21.15.151:0/918383966 conn(0x7f373c0c75c0 msgr2=0x7f373c0c5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.193+0000 7f3742f17700 1 -- 172.21.15.151:0/918383966 shutdown_connections 2022-03-15T05:50:14.197 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.194+0000 7f3742f17700 1 -- 172.21.15.151:0/918383966 wait complete. 2022-03-15T05:50:14.229 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.227+0000 7f0834357700 1 -- 172.21.15.151:0/1804285598 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f08100056b0 con 0x7f082c151300 2022-03-15T05:50:14.229 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.228+0000 7f081a7fc700 1 -- 172.21.15.151:0/1804285598 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0828053bd0 con 0x7f082c151300 2022-03-15T05:50:14.233 INFO:teuthology.orchestra.run.smithi151.stdout:60129542154 2022-03-15T05:50:14.234 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.232+0000 7f0834357700 1 -- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f080c063510 msgr2=0x7f080c0659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.235 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.232+0000 7f0834357700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f080c063510 0x7f080c0659c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f081c00b9b0 tx=0x7f081c008040 comp rx=0 tx=0).stop 2022-03-15T05:50:14.235 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.232+0000 7f0834357700 1 -- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 msgr2=0x7f082c149130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.235 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.232+0000 7f0834357700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 0x7f082c149130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0828015000 tx=0x7f0828013000 comp rx=0 tx=0).stop 2022-03-15T05:50:14.236 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.233+0000 7f0834357700 1 -- 172.21.15.151:0/1804285598 shutdown_connections 2022-03-15T05:50:14.236 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.233+0000 7f0834357700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f080c063510 0x7f080c0659c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.236 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.233+0000 7f0834357700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f082c152330 0x7f082c0bc750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.236 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.233+0000 7f0834357700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f082c0c3d00 0x7f082c0c63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.237 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.233+0000 7f0834357700 1 --2- 172.21.15.151:0/1804285598 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f082c151300 0x7f082c149130 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.237 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.233+0000 7f0834357700 1 -- 172.21.15.151:0/1804285598 >> 172.21.15.151:0/1804285598 conn(0x7f082c0c75c0 msgr2=0x7f082c0c08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:14.237 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.234+0000 7f0834357700 1 -- 172.21.15.151:0/1804285598 shutdown_connections 2022-03-15T05:50:14.238 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.234+0000 7f0834357700 1 -- 172.21.15.151:0/1804285598 wait complete. 2022-03-15T05:50:14.240 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.1 2022-03-15T05:50:14.241 DEBUG:teuthology.parallel:result is None 2022-03-15T05:50:14.279 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.0 2022-03-15T05:50:14.280 DEBUG:teuthology.parallel:result is None 2022-03-15T05:50:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.281+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2990323414 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5acc06d4b0 con 0x7f5acc0c3d00 2022-03-15T05:50:14.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.282+0000 7f5ac8ff9700 1 -- 172.21.15.151:0/2990323414 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ac404f290 con 0x7f5acc0c3d00 2022-03-15T05:50:14.284 INFO:teuthology.orchestra.run.smithi151.stdout:60129542154 2022-03-15T05:50:14.286 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.284+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5ab4063510 msgr2=0x7f5ab40659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.286 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.284+0000 7f5ad2c88700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5ab4063510 0x7f5ab40659c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5ab8006fd0 tx=0x7f5ab8016000 comp rx=0 tx=0).stop 2022-03-15T05:50:14.287 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.284+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2990323414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 msgr2=0x7f5acc1404c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.287 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.284+0000 7f5ad2c88700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 0x7f5acc1404c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400c7c0 tx=0x7f5ac40014c0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.288 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.285+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2990323414 shutdown_connections 2022-03-15T05:50:14.288 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.285+0000 7f5ad2c88700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5ab4063510 0x7f5ab40659c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.290 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.285+0000 7f5ad2c88700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5acc0c3d00 0x7f5acc1404c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.285+0000 7f5ad2c88700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5acc0c0710 0x7f5acc1464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.285+0000 7f5ad2c88700 1 --2- 172.21.15.151:0/2990323414 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5acc0c0b40 0x7f5acc0c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.285+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2990323414 >> 172.21.15.151:0/2990323414 conn(0x7f5acc0c75c0 msgr2=0x7f5acc14fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:14.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.285+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2990323414 shutdown_connections 2022-03-15T05:50:14.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.285+0000 7f5ad2c88700 1 -- 172.21.15.151:0/2990323414 wait complete. 2022-03-15T05:50:14.306 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.304+0000 7f44f8b7b700 1 -- 172.21.15.151:0/415491359 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44f404b760 con 0x7f44f4066b40 2022-03-15T05:50:14.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.305+0000 7f44e27fc700 1 -- 172.21.15.151:0/415491359 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44e4053e10 con 0x7f44f4066b40 2022-03-15T05:50:14.307 INFO:teuthology.orchestra.run.smithi151.stdout:64424509449 2022-03-15T05:50:14.312 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 -- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f44d8063510 msgr2=0x7f44d80659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.313 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f44d8063510 0x7f44d80659c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f44f406c4d0 tx=0x7f44ec00b040 comp rx=0 tx=0).stop 2022-03-15T05:50:14.313 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 -- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 msgr2=0x7f44f4139920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.313 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f4139920 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f44f406d9e0 tx=0x7f44e4017000 comp rx=0 tx=0).stop 2022-03-15T05:50:14.313 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 -- 172.21.15.151:0/415491359 shutdown_connections 2022-03-15T05:50:14.314 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f44d8063510 0x7f44d80659c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.314 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44f40c4090 0x7f44f40c5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.314 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f44f4066b40 0x7f44f4139920 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.315 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 --2- 172.21.15.151:0/415491359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f4067c20 0x7f44f40b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.315 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 -- 172.21.15.151:0/415491359 >> 172.21.15.151:0/415491359 conn(0x7f44f40c75c0 msgr2=0x7f44f4066f10 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:14.315 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 -- 172.21.15.151:0/415491359 shutdown_connections 2022-03-15T05:50:14.315 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.309+0000 7f44f8b7b700 1 -- 172.21.15.151:0/415491359 wait complete. 2022-03-15T05:50:14.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.320+0000 7f14b93f2700 1 -- 172.21.15.151:0/1326960824 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f14b40b6720 con 0x7f14b4066b40 2022-03-15T05:50:14.323 INFO:teuthology.orchestra.run.smithi151.stdout:60129542153 2022-03-15T05:50:14.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.320+0000 7f149affd700 1 -- 172.21.15.151:0/1326960824 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f14b40b6720 con 0x7f14b4066b40 2022-03-15T05:50:14.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.323+0000 7f5c682e9700 1 -- 172.21.15.151:0/2662374304 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5c6004b760 con 0x7f5c60067c20 2022-03-15T05:50:14.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.323+0000 7f5c4e7fc700 1 -- 172.21.15.151:0/2662374304 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5c58018070 con 0x7f5c60067c20 2022-03-15T05:50:14.326 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 -- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1494063510 msgr2=0x7f14940659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.326 INFO:teuthology.orchestra.run.smithi151.stdout:64424509448 2022-03-15T05:50:14.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1494063510 0x7f14940659c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f14a8006fd0 tx=0x7f14a8017000 comp rx=0 tx=0).stop 2022-03-15T05:50:14.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 -- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b4066b40 msgr2=0x7f14b41469e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b4066b40 0x7f14b41469e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f14ac00bc30 tx=0x7f14ac009840 comp rx=0 tx=0).stop 2022-03-15T05:50:14.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 -- 172.21.15.151:0/1326960824 shutdown_connections 2022-03-15T05:50:14.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f1494063510 0x7f14940659c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f14b40b6c40 0x7f14b413a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f14b4066b40 0x7f14b41469e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 --2- 172.21.15.151:0/1326960824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14b4067c20 0x7f14b413a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 -- 172.21.15.151:0/1326960824 >> 172.21.15.151:0/1326960824 conn(0x7f14b40c75c0 msgr2=0x7f14b40c5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:14.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 -- 172.21.15.151:0/1326960824 shutdown_connections 2022-03-15T05:50:14.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.324+0000 7f14b93f2700 1 -- 172.21.15.151:0/1326960824 wait complete. 2022-03-15T05:50:14.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.5 2022-03-15T05:50:14.331 DEBUG:teuthology.parallel:result is None 2022-03-15T05:50:14.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.327+0000 7f5c682e9700 1 -- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5c40063490 msgr2=0x7f5c40065940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5c40063490 0x7f5c40065940 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009520 tx=0x7f5c5c006a40 comp rx=0 tx=0).stop 2022-03-15T05:50:14.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 -- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60067c20 msgr2=0x7f5c600c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60067c20 0x7f5c600c5800 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800c870 tx=0x7f5c580015e0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 -- 172.21.15.151:0/2662374304 shutdown_connections 2022-03-15T05:50:14.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5c40063490 0x7f5c40065940 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c009520 tx=0x7f5c5c006a40 comp rx=0 tx=0).stop 2022-03-15T05:50:14.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c600c4090 0x7f5c60152190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c60066b40 0x7f5c60174b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 --2- 172.21.15.151:0/2662374304 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5c60067c20 0x7f5c600c5800 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 -- 172.21.15.151:0/2662374304 >> 172.21.15.151:0/2662374304 conn(0x7f5c600c75c0 msgr2=0x7f5c601536c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:14.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 -- 172.21.15.151:0/2662374304 shutdown_connections 2022-03-15T05:50:14.335 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.328+0000 7f5c682e9700 1 -- 172.21.15.151:0/2662374304 wait complete. 2022-03-15T05:50:14.338 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.336+0000 7fbe01aba700 1 -- 172.21.15.151:0/2751879538 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbdd80053e0 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.339 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.337+0000 7fbde37fe700 1 -- 172.21.15.151:0/2751879538 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbdec029030 con 0x7fbdfc0c3d00 2022-03-15T05:50:14.339 INFO:teuthology.orchestra.run.smithi151.stdout:60129542154 2022-03-15T05:50:14.340 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.337+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/181315283 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbf04169590 con 0x7fbf0415ef70 2022-03-15T05:50:14.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.3 2022-03-15T05:50:14.341 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.338+0000 7fbef1ffb700 1 -- 172.21.15.151:0/181315283 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbf04169590 con 0x7fbf0415ef70 2022-03-15T05:50:14.342 INFO:teuthology.orchestra.run.smithi151.stdout:60129542153 2022-03-15T05:50:14.342 DEBUG:teuthology.parallel:result is None 2022-03-15T05:50:14.343 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 -- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbddc063540 msgr2=0x7fbddc0659f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.344 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbddc063540 0x7fbddc0659f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0001860 tx=0x7fbdf0009040 comp rx=0 tx=0).stop 2022-03-15T05:50:14.344 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 -- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc0c3d00 msgr2=0x7fbdfc0bc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.344 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc0c3d00 0x7fbdfc0bc910 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbdec009130 tx=0x7fbdec016000 comp rx=0 tx=0).stop 2022-03-15T05:50:14.344 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 -- 172.21.15.151:0/2751879538 shutdown_connections 2022-03-15T05:50:14.345 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbddc063540 0x7fbddc0659f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.345 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbdfc151300 0x7fbdfc1625c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.345 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbdfc066ec0 0x7fbdfc14d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.345 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 --2- 172.21.15.151:0/2751879538 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbdfc0c3d00 0x7fbdfc0bc910 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.345 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 -- 172.21.15.151:0/2751879538 >> 172.21.15.151:0/2751879538 conn(0x7fbdfc0c75c0 msgr2=0x7fbdfc0c3200 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:14.346 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbee40634c0 msgr2=0x7fbee4065970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.346 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbf0bdd4700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbee40634c0 0x7fbee4065970 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbef4006f70 tx=0x7fbef4016000 comp rx=0 tx=0).stop 2022-03-15T05:50:14.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.340+0000 7fbe01aba700 1 -- 172.21.15.151:0/2751879538 shutdown_connections 2022-03-15T05:50:14.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/181315283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf0415ef70 msgr2=0x7fbf04152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.348 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbf0bdd4700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf0415ef70 0x7fbf04152080 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fbefc00c7c0 tx=0x7fbefc007f30 comp rx=0 tx=0).stop 2022-03-15T05:50:14.348 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbe01aba700 1 -- 172.21.15.151:0/2751879538 wait complete. 2022-03-15T05:50:14.349 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/181315283 shutdown_connections 2022-03-15T05:50:14.349 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbf0bdd4700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fbee40634c0 0x7fbee4065970 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.349 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbf0bdd4700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf0415ef70 0x7fbf04152080 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.350 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbf0bdd4700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fbf04066b40 0x7fbf04154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.350 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbf0bdd4700 1 --2- 172.21.15.151:0/181315283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf04067c20 0x7fbf040c0710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.350 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/181315283 >> 172.21.15.151:0/181315283 conn(0x7fbf040c75c0 msgr2=0x7fbf040c4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:14.350 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/181315283 shutdown_connections 2022-03-15T05:50:14.351 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.341+0000 7fbf0bdd4700 1 -- 172.21.15.151:0/181315283 wait complete. 2022-03-15T05:50:14.368 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.4 2022-03-15T05:50:14.368 DEBUG:teuthology.parallel:result is None 2022-03-15T05:50:14.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.6 2022-03-15T05:50:14.371 DEBUG:teuthology.parallel:result is None 2022-03-15T05:50:14.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2022-03-15T05:50:14.372 DEBUG:teuthology.parallel:result is None 2022-03-15T05:50:14.373 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542153 for osd.7 2022-03-15T05:50:14.373 DEBUG:teuthology.parallel:result is None 2022-03-15T05:50:14.373 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2022-03-15T05:50:14.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-03-15T05:50:14.618 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.616+0000 7f40b90b0700 1 Processor -- start 2022-03-15T05:50:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.616+0000 7f40b90b0700 1 -- start start 2022-03-15T05:50:14.621 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.617+0000 7f40b90b0700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f40b40cb1f0 0x7f40b40c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.621 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.617+0000 7f40b90b0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b40cb5c0 0x7f40b4155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.621 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.617+0000 7f40b90b0700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40b41566c0 0x7f40b40c58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.617+0000 7f40b90b0700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40c27b0 con 0x7f40b41566c0 2022-03-15T05:50:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.617+0000 7f40b90b0700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b40c4f90 con 0x7f40b40cb1f0 2022-03-15T05:50:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.617+0000 7f40b90b0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40c5270 con 0x7f40b40cb5c0 2022-03-15T05:50:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b359e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40b41566c0 0x7f40b40c58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b259c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b40cb5c0 0x7f40b4155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b2d9d700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f40b40cb1f0 0x7f40b40c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b359e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f40b41566c0 0x7f40b40c58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60112/0 (socket says 172.21.15.151:60112) 2022-03-15T05:50:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b359e700 1 -- 172.21.15.151:0/890060505 learned_addr learned my addr 172.21.15.151:0/890060505 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b259c700 1 -- 172.21.15.151:0/890060505 >> v2:172.21.15.164:3300/0 conn(0x7f40b40cb1f0 msgr2=0x7f40b40c34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b259c700 1 --2- 172.21.15.151:0/890060505 >> v2:172.21.15.164:3300/0 conn(0x7f40b40cb1f0 0x7f40b40c34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b259c700 1 -- 172.21.15.151:0/890060505 >> v2:172.21.15.151:3300/0 conn(0x7f40b41566c0 msgr2=0x7f40b40c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b259c700 1 --2- 172.21.15.151:0/890060505 >> v2:172.21.15.151:3300/0 conn(0x7f40b41566c0 0x7f40b40c58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.624 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b259c700 1 -- 172.21.15.151:0/890060505 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b40c2a00 con 0x7f40b40cb5c0 2022-03-15T05:50:14.625 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.618+0000 7f40b359e700 1 --2- 172.21.15.151:0/890060505 >> v2:172.21.15.151:3300/0 conn(0x7f40b41566c0 0x7f40b40c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:14.625 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.619+0000 7f40b259c700 1 --2- 172.21.15.151:0/890060505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b40cb5c0 0x7f40b4155cf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40b4088f70 tx=0x7f40a8009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=501d5eb9aff7a6e5 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.625 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.619+0000 7f40b1d9b700 1 -- 172.21.15.151:0/890060505 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a80105b0 con 0x7f40b40cb5c0 2022-03-15T05:50:14.625 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.619+0000 7f40b1d9b700 1 -- 172.21.15.151:0/890060505 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a8010710 con 0x7f40b40cb5c0 2022-03-15T05:50:14.625 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.619+0000 7f40b1d9b700 1 -- 172.21.15.151:0/890060505 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a8010ad0 con 0x7f40b40cb5c0 2022-03-15T05:50:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.620+0000 7f40b90b0700 1 -- 172.21.15.151:0/890060505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b40cb5c0 msgr2=0x7f40b4155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.630 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.620+0000 7f40b90b0700 1 --2- 172.21.15.151:0/890060505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b40cb5c0 0x7f40b4155cf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f40b4088f70 tx=0x7f40a8009060 comp rx=0 tx=0).stop 2022-03-15T05:50:14.630 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.620+0000 7f40b90b0700 1 -- 172.21.15.151:0/890060505 shutdown_connections 2022-03-15T05:50:14.630 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.620+0000 7f40b90b0700 1 --2- 172.21.15.151:0/890060505 >> v2:172.21.15.151:3300/0 conn(0x7f40b41566c0 0x7f40b40c58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.630 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.620+0000 7f40b90b0700 1 --2- 172.21.15.151:0/890060505 >> v2:172.21.15.164:3300/0 conn(0x7f40b40cb1f0 0x7f40b40c34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.620+0000 7f40b90b0700 1 --2- 172.21.15.151:0/890060505 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b40cb5c0 0x7f40b4155cf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.620+0000 7f40b90b0700 1 -- 172.21.15.151:0/890060505 >> 172.21.15.151:0/890060505 conn(0x7f40b4068e90 msgr2=0x7f40b4069290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.620+0000 7f40b90b0700 1 -- 172.21.15.151:0/890060505 shutdown_connections 2022-03-15T05:50:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.620+0000 7f40b90b0700 1 -- 172.21.15.151:0/890060505 wait complete. 2022-03-15T05:50:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.621+0000 7f40b90b0700 1 Processor -- start 2022-03-15T05:50:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.622+0000 7f40b90b0700 1 -- start start 2022-03-15T05:50:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b90b0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40b40cb1f0 0x7f40b4154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b90b0700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40b40cb5c0 0x7f40b41668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b90b0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b41566c0 0x7f40b4166e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.633 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b90b0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b41658a0 con 0x7f40b40cb1f0 2022-03-15T05:50:14.633 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b90b0700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4166470 con 0x7f40b40cb5c0 2022-03-15T05:50:14.633 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b90b0700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4165d60 con 0x7f40b41566c0 2022-03-15T05:50:14.633 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40b40cb1f0 0x7f40b4154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.634 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40b40cb1f0 0x7f40b4154300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60114/0 (socket says 172.21.15.151:60114) 2022-03-15T05:50:14.634 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b2d9d700 1 -- 172.21.15.151:0/2881795154 learned_addr learned my addr 172.21.15.151:0/2881795154 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:14.634 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b359e700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b41566c0 0x7f40b4166e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.634 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b259c700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40b40cb5c0 0x7f40b41668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.634 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b2d9d700 1 -- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b41566c0 msgr2=0x7f40b4166e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b2d9d700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b41566c0 0x7f40b4166e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b2d9d700 1 -- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40b40cb5c0 msgr2=0x7f40b41668c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b2d9d700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40b40cb5c0 0x7f40b41668c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.635 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b2d9d700 1 -- 172.21.15.151:0/2881795154 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40ac009ae0 con 0x7f40b40cb1f0 2022-03-15T05:50:14.636 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.623+0000 7f40b359e700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b41566c0 0x7f40b4166e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:14.636 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.624+0000 7f40b2d9d700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40b40cb1f0 0x7f40b4154300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f40a400e900 tx=0x7f40a4009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.636 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.624+0000 7f409affd700 1 -- 172.21.15.151:0/2881795154 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4013680 con 0x7f40b40cb1f0 2022-03-15T05:50:14.636 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.624+0000 7f409affd700 1 -- 172.21.15.151:0/2881795154 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a40137e0 con 0x7f40b40cb1f0 2022-03-15T05:50:14.636 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.624+0000 7f40b90b0700 1 -- 172.21.15.151:0/2881795154 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a80092a0 con 0x7f40b40cb1f0 2022-03-15T05:50:14.637 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.624+0000 7f409affd700 1 -- 172.21.15.151:0/2881795154 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a4013b60 con 0x7f40b40cb1f0 2022-03-15T05:50:14.637 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.624+0000 7f40b90b0700 1 -- 172.21.15.151:0/2881795154 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b40ca320 con 0x7f40b40cb1f0 2022-03-15T05:50:14.637 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.625+0000 7f40b90b0700 1 -- 172.21.15.151:0/2881795154 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b40b0b30 con 0x7f40b40cb1f0 2022-03-15T05:50:14.637 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.626+0000 7f409affd700 1 -- 172.21.15.151:0/2881795154 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f40a4019030 con 0x7f40b40cb1f0 2022-03-15T05:50:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.627+0000 7f409affd700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40940633f0 0x7f40940658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.627+0000 7f409affd700 1 -- 172.21.15.151:0/2881795154 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f40a407fac0 con 0x7f40b40cb1f0 2022-03-15T05:50:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.627+0000 7f40b259c700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40940633f0 0x7f40940658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:14.638 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.628+0000 7f40b259c700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40940633f0 0x7f40940658a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009fd0 tx=0x7f40a8016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:14.639 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.631+0000 7f409affd700 1 -- 172.21.15.151:0/2881795154 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f40b40b0b30 con 0x7f40b40cb1f0 2022-03-15T05:50:14.822 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.820+0000 7f40b90b0700 1 -- 172.21.15.151:0/2881795154 --> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f40b40b0b30 con 0x7f40940633f0 2022-03-15T05:50:14.831 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.829+0000 7f409affd700 1 -- 172.21.15.151:0/2881795154 <== mgr.4111 v2:172.21.15.164:6832/40466 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278276 (secure 0 0 0) 0x7f40b40b0b30 con 0x7f40940633f0 2022-03-15T05:50:14.835 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:14.838 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 -- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40940633f0 msgr2=0x7f40940658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.838 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40940633f0 0x7f40940658a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f40a8009fd0 tx=0x7f40a8016000 comp rx=0 tx=0).stop 2022-03-15T05:50:14.839 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 -- 172.21.15.151:0/2881795154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40b40cb1f0 msgr2=0x7f40b4154300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:14.839 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40b40cb1f0 0x7f40b4154300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f40a400e900 tx=0x7f40a4009060 comp rx=0 tx=0).stop 2022-03-15T05:50:14.839 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 -- 172.21.15.151:0/2881795154 shutdown_connections 2022-03-15T05:50:14.839 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f40940633f0 0x7f40940658a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.840 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f40b41566c0 0x7f40b4166e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.840 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40b40cb1f0 0x7f40b4154300 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.840 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 --2- 172.21.15.151:0/2881795154 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f40b40cb5c0 0x7f40b41668c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:14.840 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 -- 172.21.15.151:0/2881795154 >> 172.21.15.151:0/2881795154 conn(0x7f40b4068e90 msgr2=0x7f40b41524c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:14.840 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 -- 172.21.15.151:0/2881795154 shutdown_connections 2022-03-15T05:50:14.841 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:14.834+0000 7f40b90b0700 1 -- 172.21.15.151:0/2881795154 wait complete. 2022-03-15T05:50:14.841 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2022-03-15T05:50:14.860 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2022-03-15T05:50:14.652032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592810,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":217,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":65672,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":62592,"kb_avail":754909048,"statfs":{"total":773094113280,"available":773026865152,"internally_reserved":0,"allocated":3088384,"data_stored":1794910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64094208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2442,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.394862"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273754+0000","last_change":"2022-03-15T05:50:02.270526+0000","last_active":"2022-03-15T05:50:02.273754+0000","last_peered":"2022-03-15T05:50:02.273754+0000","last_clean":"2022-03-15T05:50:02.273754+0000","last_became_active":"2022-03-15T05:50:02.270047+0000","last_became_peered":"2022-03-15T05:50:02.270047+0000","last_unstale":"2022-03-15T05:50:02.273754+0000","last_undegraded":"2022-03-15T05:50:02.273754+0000","last_fullsized":"2022-03-15T05:50:02.273754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:19:07.916578+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275970+0000","last_change":"2022-03-15T05:50:02.272082+0000","last_active":"2022-03-15T05:50:02.275970+0000","last_peered":"2022-03-15T05:50:02.275970+0000","last_clean":"2022-03-15T05:50:02.275970+0000","last_became_active":"2022-03-15T05:50:02.271830+0000","last_became_peered":"2022-03-15T05:50:02.271830+0000","last_unstale":"2022-03-15T05:50:02.275970+0000","last_undegraded":"2022-03-15T05:50:02.275970+0000","last_fullsized":"2022-03-15T05:50:02.275970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:11:22.661539+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277940+0000","last_change":"2022-03-15T05:50:02.274527+0000","last_active":"2022-03-15T05:50:02.277940+0000","last_peered":"2022-03-15T05:50:02.277940+0000","last_clean":"2022-03-15T05:50:02.277940+0000","last_became_active":"2022-03-15T05:50:02.274276+0000","last_became_peered":"2022-03-15T05:50:02.274276+0000","last_unstale":"2022-03-15T05:50:02.277940+0000","last_undegraded":"2022-03-15T05:50:02.277940+0000","last_fullsized":"2022-03-15T05:50:02.277940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:30:36.811134+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278491+0000","last_change":"2022-03-15T05:50:02.273391+0000","last_active":"2022-03-15T05:50:02.278491+0000","last_peered":"2022-03-15T05:50:02.278491+0000","last_clean":"2022-03-15T05:50:02.278491+0000","last_became_active":"2022-03-15T05:50:02.273048+0000","last_became_peered":"2022-03-15T05:50:02.273048+0000","last_unstale":"2022-03-15T05:50:02.278491+0000","last_undegraded":"2022-03-15T05:50:02.278491+0000","last_fullsized":"2022-03-15T05:50:02.278491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:29:30.963367+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279283+0000","last_change":"2022-03-15T05:50:02.275876+0000","last_active":"2022-03-15T05:50:02.279283+0000","last_peered":"2022-03-15T05:50:02.279283+0000","last_clean":"2022-03-15T05:50:02.279283+0000","last_became_active":"2022-03-15T05:50:02.275568+0000","last_became_peered":"2022-03-15T05:50:02.275568+0000","last_unstale":"2022-03-15T05:50:02.279283+0000","last_undegraded":"2022-03-15T05:50:02.279283+0000","last_fullsized":"2022-03-15T05:50:02.279283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:49:14.636242+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285627+0000","last_change":"2022-03-15T05:50:02.280155+0000","last_active":"2022-03-15T05:50:02.285627+0000","last_peered":"2022-03-15T05:50:02.285627+0000","last_clean":"2022-03-15T05:50:02.285627+0000","last_became_active":"2022-03-15T05:50:02.279866+0000","last_became_peered":"2022-03-15T05:50:02.279866+0000","last_unstale":"2022-03-15T05:50:02.285627+0000","last_undegraded":"2022-03-15T05:50:02.285627+0000","last_fullsized":"2022-03-15T05:50:02.285627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:18:11.481888+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281731+0000","last_change":"2022-03-15T05:50:02.274634+0000","last_active":"2022-03-15T05:50:02.281731+0000","last_peered":"2022-03-15T05:50:02.281731+0000","last_clean":"2022-03-15T05:50:02.281731+0000","last_became_active":"2022-03-15T05:50:02.274365+0000","last_became_peered":"2022-03-15T05:50:02.274365+0000","last_unstale":"2022-03-15T05:50:02.281731+0000","last_undegraded":"2022-03-15T05:50:02.281731+0000","last_fullsized":"2022-03-15T05:50:02.281731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:30:21.663420+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286792+0000","last_change":"2022-03-15T05:50:02.285013+0000","last_active":"2022-03-15T05:50:02.286792+0000","last_peered":"2022-03-15T05:50:02.286792+0000","last_clean":"2022-03-15T05:50:02.286792+0000","last_became_active":"2022-03-15T05:50:02.284464+0000","last_became_peered":"2022-03-15T05:50:02.284464+0000","last_unstale":"2022-03-15T05:50:02.286792+0000","last_undegraded":"2022-03-15T05:50:02.286792+0000","last_fullsized":"2022-03-15T05:50:02.286792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:46:35.006614+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273371+0000","last_change":"2022-03-15T05:50:02.270735+0000","last_active":"2022-03-15T05:50:02.273371+0000","last_peered":"2022-03-15T05:50:02.273371+0000","last_clean":"2022-03-15T05:50:02.273371+0000","last_became_active":"2022-03-15T05:50:02.270318+0000","last_became_peered":"2022-03-15T05:50:02.270318+0000","last_unstale":"2022-03-15T05:50:02.273371+0000","last_undegraded":"2022-03-15T05:50:02.273371+0000","last_fullsized":"2022-03-15T05:50:02.273371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:12:33.142086+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278502+0000","last_change":"2022-03-15T05:50:02.273007+0000","last_active":"2022-03-15T05:50:02.278502+0000","last_peered":"2022-03-15T05:50:02.278502+0000","last_clean":"2022-03-15T05:50:02.278502+0000","last_became_active":"2022-03-15T05:50:02.272523+0000","last_became_peered":"2022-03-15T05:50:02.272523+0000","last_unstale":"2022-03-15T05:50:02.278502+0000","last_undegraded":"2022-03-15T05:50:02.278502+0000","last_fullsized":"2022-03-15T05:50:02.278502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:21:35.681401+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286135+0000","last_change":"2022-03-15T05:50:02.278777+0000","last_active":"2022-03-15T05:50:02.286135+0000","last_peered":"2022-03-15T05:50:02.286135+0000","last_clean":"2022-03-15T05:50:02.286135+0000","last_became_active":"2022-03-15T05:50:02.278500+0000","last_became_peered":"2022-03-15T05:50:02.278500+0000","last_unstale":"2022-03-15T05:50:02.286135+0000","last_undegraded":"2022-03-15T05:50:02.286135+0000","last_fullsized":"2022-03-15T05:50:02.286135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:38:10.301072+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284707+0000","last_change":"2022-03-15T05:50:02.283008+0000","last_active":"2022-03-15T05:50:02.284707+0000","last_peered":"2022-03-15T05:50:02.284707+0000","last_clean":"2022-03-15T05:50:02.284707+0000","last_became_active":"2022-03-15T05:50:02.282701+0000","last_became_peered":"2022-03-15T05:50:02.282701+0000","last_unstale":"2022-03-15T05:50:02.284707+0000","last_undegraded":"2022-03-15T05:50:02.284707+0000","last_fullsized":"2022-03-15T05:50:02.284707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:27:00.079571+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277381+0000","last_change":"2022-03-15T05:50:02.274545+0000","last_active":"2022-03-15T05:50:02.277381+0000","last_peered":"2022-03-15T05:50:02.277381+0000","last_clean":"2022-03-15T05:50:02.277381+0000","last_became_active":"2022-03-15T05:50:02.274210+0000","last_became_peered":"2022-03-15T05:50:02.274210+0000","last_unstale":"2022-03-15T05:50:02.277381+0000","last_undegraded":"2022-03-15T05:50:02.277381+0000","last_fullsized":"2022-03-15T05:50:02.277381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:56:38.005714+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282124+0000","last_change":"2022-03-15T05:50:02.276880+0000","last_active":"2022-03-15T05:50:02.282124+0000","last_peered":"2022-03-15T05:50:02.282124+0000","last_clean":"2022-03-15T05:50:02.282124+0000","last_became_active":"2022-03-15T05:50:02.276611+0000","last_became_peered":"2022-03-15T05:50:02.276611+0000","last_unstale":"2022-03-15T05:50:02.282124+0000","last_undegraded":"2022-03-15T05:50:02.282124+0000","last_fullsized":"2022-03-15T05:50:02.282124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:00:13.209564+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278683+0000","last_change":"2022-03-15T05:50:02.276997+0000","last_active":"2022-03-15T05:50:02.278683+0000","last_peered":"2022-03-15T05:50:02.278683+0000","last_clean":"2022-03-15T05:50:02.278683+0000","last_became_active":"2022-03-15T05:50:02.276696+0000","last_became_peered":"2022-03-15T05:50:02.276696+0000","last_unstale":"2022-03-15T05:50:02.278683+0000","last_undegraded":"2022-03-15T05:50:02.278683+0000","last_fullsized":"2022-03-15T05:50:02.278683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:00:32.831962+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281465+0000","last_change":"2022-03-15T05:50:02.269800+0000","last_active":"2022-03-15T05:50:02.281465+0000","last_peered":"2022-03-15T05:50:02.281465+0000","last_clean":"2022-03-15T05:50:02.281465+0000","last_became_active":"2022-03-15T05:50:02.269477+0000","last_became_peered":"2022-03-15T05:50:02.269477+0000","last_unstale":"2022-03-15T05:50:02.281465+0000","last_undegraded":"2022-03-15T05:50:02.281465+0000","last_fullsized":"2022-03-15T05:50:02.281465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:24:26.061545+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275881+0000","last_change":"2022-03-15T05:50:02.269504+0000","last_active":"2022-03-15T05:50:02.275881+0000","last_peered":"2022-03-15T05:50:02.275881+0000","last_clean":"2022-03-15T05:50:02.275881+0000","last_became_active":"2022-03-15T05:50:02.269199+0000","last_became_peered":"2022-03-15T05:50:02.269199+0000","last_unstale":"2022-03-15T05:50:02.275881+0000","last_undegraded":"2022-03-15T05:50:02.275881+0000","last_fullsized":"2022-03-15T05:50:02.275881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:48:27.314870+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280537+0000","last_change":"2022-03-15T05:50:02.271878+0000","last_active":"2022-03-15T05:50:02.280537+0000","last_peered":"2022-03-15T05:50:02.280537+0000","last_clean":"2022-03-15T05:50:02.280537+0000","last_became_active":"2022-03-15T05:50:02.271545+0000","last_became_peered":"2022-03-15T05:50:02.271545+0000","last_unstale":"2022-03-15T05:50:02.280537+0000","last_undegraded":"2022-03-15T05:50:02.280537+0000","last_fullsized":"2022-03-15T05:50:02.280537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:29:55.714092+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284711+0000","last_change":"2022-03-15T05:50:02.283062+0000","last_active":"2022-03-15T05:50:02.284711+0000","last_peered":"2022-03-15T05:50:02.284711+0000","last_clean":"2022-03-15T05:50:02.284711+0000","last_became_active":"2022-03-15T05:50:02.282688+0000","last_became_peered":"2022-03-15T05:50:02.282688+0000","last_unstale":"2022-03-15T05:50:02.284711+0000","last_undegraded":"2022-03-15T05:50:02.284711+0000","last_fullsized":"2022-03-15T05:50:02.284711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:28:47.117343+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.276419+0000","last_change":"2022-03-15T05:50:02.267259+0000","last_active":"2022-03-15T05:50:02.276419+0000","last_peered":"2022-03-15T05:50:02.276419+0000","last_clean":"2022-03-15T05:50:02.276419+0000","last_became_active":"2022-03-15T05:50:02.266987+0000","last_became_peered":"2022-03-15T05:50:02.266987+0000","last_unstale":"2022-03-15T05:50:02.276419+0000","last_undegraded":"2022-03-15T05:50:02.276419+0000","last_fullsized":"2022-03-15T05:50:02.276419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:58:11.812955+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280321+0000","last_change":"2022-03-15T05:50:02.276941+0000","last_active":"2022-03-15T05:50:02.280321+0000","last_peered":"2022-03-15T05:50:02.280321+0000","last_clean":"2022-03-15T05:50:02.280321+0000","last_became_active":"2022-03-15T05:50:02.276681+0000","last_became_peered":"2022-03-15T05:50:02.276681+0000","last_unstale":"2022-03-15T05:50:02.280321+0000","last_undegraded":"2022-03-15T05:50:02.280321+0000","last_fullsized":"2022-03-15T05:50:02.280321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:33:21.840005+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.269747+0000","last_change":"2022-03-15T05:50:02.269105+0000","last_active":"2022-03-15T05:50:02.269747+0000","last_peered":"2022-03-15T05:50:02.269747+0000","last_clean":"2022-03-15T05:50:02.269747+0000","last_became_active":"2022-03-15T05:50:02.268808+0000","last_became_peered":"2022-03-15T05:50:02.268808+0000","last_unstale":"2022-03-15T05:50:02.269747+0000","last_undegraded":"2022-03-15T05:50:02.269747+0000","last_fullsized":"2022-03-15T05:50:02.269747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:52:28.049853+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280638+0000","last_change":"2022-03-15T05:50:02.277497+0000","last_active":"2022-03-15T05:50:02.280638+0000","last_peered":"2022-03-15T05:50:02.280638+0000","last_clean":"2022-03-15T05:50:02.280638+0000","last_became_active":"2022-03-15T05:50:02.277184+0000","last_became_peered":"2022-03-15T05:50:02.277184+0000","last_unstale":"2022-03-15T05:50:02.280638+0000","last_undegraded":"2022-03-15T05:50:02.280638+0000","last_fullsized":"2022-03-15T05:50:02.280638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:35:31.460982+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280352+0000","last_change":"2022-03-15T05:50:02.277944+0000","last_active":"2022-03-15T05:50:02.280352+0000","last_peered":"2022-03-15T05:50:02.280352+0000","last_clean":"2022-03-15T05:50:02.280352+0000","last_became_active":"2022-03-15T05:50:02.277565+0000","last_became_peered":"2022-03-15T05:50:02.277565+0000","last_unstale":"2022-03-15T05:50:02.280352+0000","last_undegraded":"2022-03-15T05:50:02.280352+0000","last_fullsized":"2022-03-15T05:50:02.280352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:05:09.174014+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278568+0000","last_change":"2022-03-15T05:50:02.273042+0000","last_active":"2022-03-15T05:50:02.278568+0000","last_peered":"2022-03-15T05:50:02.278568+0000","last_clean":"2022-03-15T05:50:02.278568+0000","last_became_active":"2022-03-15T05:50:02.272528+0000","last_became_peered":"2022-03-15T05:50:02.272528+0000","last_unstale":"2022-03-15T05:50:02.278568+0000","last_undegraded":"2022-03-15T05:50:02.278568+0000","last_fullsized":"2022-03-15T05:50:02.278568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:38:32.868531+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278082+0000","last_change":"2022-03-15T05:50:02.270444+0000","last_active":"2022-03-15T05:50:02.278082+0000","last_peered":"2022-03-15T05:50:02.278082+0000","last_clean":"2022-03-15T05:50:02.278082+0000","last_became_active":"2022-03-15T05:50:02.270129+0000","last_became_peered":"2022-03-15T05:50:02.270129+0000","last_unstale":"2022-03-15T05:50:02.278082+0000","last_undegraded":"2022-03-15T05:50:02.278082+0000","last_fullsized":"2022-03-15T05:50:02.278082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:18:58.888559+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285050+0000","last_change":"2022-03-15T05:50:02.279990+0000","last_active":"2022-03-15T05:50:02.285050+0000","last_peered":"2022-03-15T05:50:02.285050+0000","last_clean":"2022-03-15T05:50:02.285050+0000","last_became_active":"2022-03-15T05:50:02.279527+0000","last_became_peered":"2022-03-15T05:50:02.279527+0000","last_unstale":"2022-03-15T05:50:02.285050+0000","last_undegraded":"2022-03-15T05:50:02.285050+0000","last_fullsized":"2022-03-15T05:50:02.285050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:10:41.298991+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:04.413706+0000","last_change":"2022-03-15T05:50:01.757857+0000","last_active":"2022-03-15T05:50:04.413706+0000","last_peered":"2022-03-15T05:50:04.413706+0000","last_clean":"2022-03-15T05:50:04.413706+0000","last_became_active":"2022-03-15T05:50:01.757378+0000","last_became_peered":"2022-03-15T05:50:01.757378+0000","last_unstale":"2022-03-15T05:50:04.413706+0000","last_undegraded":"2022-03-15T05:50:04.413706+0000","last_fullsized":"2022-03-15T05:50:04.413706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:29:24.796802+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278203+0000","last_change":"2022-03-15T05:50:02.274309+0000","last_active":"2022-03-15T05:50:02.278203+0000","last_peered":"2022-03-15T05:50:02.278203+0000","last_clean":"2022-03-15T05:50:02.278203+0000","last_became_active":"2022-03-15T05:50:02.273944+0000","last_became_peered":"2022-03-15T05:50:02.273944+0000","last_unstale":"2022-03-15T05:50:02.278203+0000","last_undegraded":"2022-03-15T05:50:02.278203+0000","last_fullsized":"2022-03-15T05:50:02.278203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:31:34.056283+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263479+0000","last_change":"2022-03-15T05:50:01.761316+0000","last_active":"2022-03-15T05:50:02.263479+0000","last_peered":"2022-03-15T05:50:02.263479+0000","last_clean":"2022-03-15T05:50:02.263479+0000","last_became_active":"2022-03-15T05:50:01.761064+0000","last_became_peered":"2022-03-15T05:50:01.761064+0000","last_unstale":"2022-03-15T05:50:02.263479+0000","last_undegraded":"2022-03-15T05:50:02.263479+0000","last_fullsized":"2022-03-15T05:50:02.263479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:08:39.825646+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280915+0000","last_change":"2022-03-15T05:50:02.278164+0000","last_active":"2022-03-15T05:50:02.280915+0000","last_peered":"2022-03-15T05:50:02.280915+0000","last_clean":"2022-03-15T05:50:02.280915+0000","last_became_active":"2022-03-15T05:50:02.277785+0000","last_became_peered":"2022-03-15T05:50:02.277785+0000","last_unstale":"2022-03-15T05:50:02.280915+0000","last_undegraded":"2022-03-15T05:50:02.280915+0000","last_fullsized":"2022-03-15T05:50:02.280915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:55:34.060331+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266525+0000","last_change":"2022-03-15T05:50:01.756648+0000","last_active":"2022-03-15T05:50:02.266525+0000","last_peered":"2022-03-15T05:50:02.266525+0000","last_clean":"2022-03-15T05:50:02.266525+0000","last_became_active":"2022-03-15T05:50:01.755611+0000","last_became_peered":"2022-03-15T05:50:01.755611+0000","last_unstale":"2022-03-15T05:50:02.266525+0000","last_undegraded":"2022-03-15T05:50:02.266525+0000","last_fullsized":"2022-03-15T05:50:02.266525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:34:52.558274+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281413+0000","last_change":"2022-03-15T05:50:02.273665+0000","last_active":"2022-03-15T05:50:02.281413+0000","last_peered":"2022-03-15T05:50:02.281413+0000","last_clean":"2022-03-15T05:50:02.281413+0000","last_became_active":"2022-03-15T05:50:02.273305+0000","last_became_peered":"2022-03-15T05:50:02.273305+0000","last_unstale":"2022-03-15T05:50:02.281413+0000","last_undegraded":"2022-03-15T05:50:02.281413+0000","last_fullsized":"2022-03-15T05:50:02.281413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:09:21.723908+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.268432+0000","last_change":"2022-03-15T05:50:01.766117+0000","last_active":"2022-03-15T05:50:02.268432+0000","last_peered":"2022-03-15T05:50:02.268432+0000","last_clean":"2022-03-15T05:50:02.268432+0000","last_became_active":"2022-03-15T05:50:01.765787+0000","last_became_peered":"2022-03-15T05:50:01.765787+0000","last_unstale":"2022-03-15T05:50:02.268432+0000","last_undegraded":"2022-03-15T05:50:02.268432+0000","last_fullsized":"2022-03-15T05:50:02.268432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:01:30.570219+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282069+0000","last_change":"2022-03-15T05:50:02.281022+0000","last_active":"2022-03-15T05:50:02.282069+0000","last_peered":"2022-03-15T05:50:02.282069+0000","last_clean":"2022-03-15T05:50:02.282069+0000","last_became_active":"2022-03-15T05:50:02.280637+0000","last_became_peered":"2022-03-15T05:50:02.280637+0000","last_unstale":"2022-03-15T05:50:02.282069+0000","last_undegraded":"2022-03-15T05:50:02.282069+0000","last_fullsized":"2022-03-15T05:50:02.282069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:22:20.683447+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:12.665379+0000","last_change":"2022-03-15T05:50:01.761879+0000","last_active":"2022-03-15T05:50:12.665379+0000","last_peered":"2022-03-15T05:50:12.665379+0000","last_clean":"2022-03-15T05:50:12.665379+0000","last_became_active":"2022-03-15T05:50:01.761612+0000","last_became_peered":"2022-03-15T05:50:01.761612+0000","last_unstale":"2022-03-15T05:50:12.665379+0000","last_undegraded":"2022-03-15T05:50:12.665379+0000","last_fullsized":"2022-03-15T05:50:12.665379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:48:49.655032+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282022+0000","last_change":"2022-03-15T05:50:02.280735+0000","last_active":"2022-03-15T05:50:02.282022+0000","last_peered":"2022-03-15T05:50:02.282022+0000","last_clean":"2022-03-15T05:50:02.282022+0000","last_became_active":"2022-03-15T05:50:02.280417+0000","last_became_peered":"2022-03-15T05:50:02.280417+0000","last_unstale":"2022-03-15T05:50:02.282022+0000","last_undegraded":"2022-03-15T05:50:02.282022+0000","last_fullsized":"2022-03-15T05:50:02.282022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:02:09.355535+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.264391+0000","last_change":"2022-03-15T05:50:01.763468+0000","last_active":"2022-03-15T05:50:07.264391+0000","last_peered":"2022-03-15T05:50:07.264391+0000","last_clean":"2022-03-15T05:50:07.264391+0000","last_became_active":"2022-03-15T05:50:01.763046+0000","last_became_peered":"2022-03-15T05:50:01.763046+0000","last_unstale":"2022-03-15T05:50:07.264391+0000","last_undegraded":"2022-03-15T05:50:07.264391+0000","last_fullsized":"2022-03-15T05:50:07.264391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:02:04.856436+0000","stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.276334+0000","last_change":"2022-03-15T05:50:02.272492+0000","last_active":"2022-03-15T05:50:02.276334+0000","last_peered":"2022-03-15T05:50:02.276334+0000","last_clean":"2022-03-15T05:50:02.276334+0000","last_became_active":"2022-03-15T05:50:02.266942+0000","last_became_peered":"2022-03-15T05:50:02.266942+0000","last_unstale":"2022-03-15T05:50:02.276334+0000","last_undegraded":"2022-03-15T05:50:02.276334+0000","last_fullsized":"2022-03-15T05:50:02.276334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:48:30.216948+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'8","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:12.666559+0000","last_change":"2022-03-15T05:50:01.767583+0000","last_active":"2022-03-15T05:50:12.666559+0000","last_peered":"2022-03-15T05:50:12.666559+0000","last_clean":"2022-03-15T05:50:12.666559+0000","last_became_active":"2022-03-15T05:50:01.766773+0000","last_became_peered":"2022-03-15T05:50:01.766773+0000","last_unstale":"2022-03-15T05:50:12.666559+0000","last_undegraded":"2022-03-15T05:50:12.666559+0000","last_fullsized":"2022-03-15T05:50:12.666559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:23:44.248528+0000","stat_sum":{"num_bytes":1548,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278156+0000","last_change":"2022-03-15T05:50:02.271456+0000","last_active":"2022-03-15T05:50:02.278156+0000","last_peered":"2022-03-15T05:50:02.278156+0000","last_clean":"2022-03-15T05:50:02.278156+0000","last_became_active":"2022-03-15T05:50:02.270402+0000","last_became_peered":"2022-03-15T05:50:02.270402+0000","last_unstale":"2022-03-15T05:50:02.278156+0000","last_undegraded":"2022-03-15T05:50:02.278156+0000","last_fullsized":"2022-03-15T05:50:02.278156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:29:17.756689+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"24'4","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:12.666209+0000","last_change":"2022-03-15T05:50:01.768867+0000","last_active":"2022-03-15T05:50:12.666209+0000","last_peered":"2022-03-15T05:50:12.666209+0000","last_clean":"2022-03-15T05:50:12.666209+0000","last_became_active":"2022-03-15T05:50:01.768586+0000","last_became_peered":"2022-03-15T05:50:01.768586+0000","last_unstale":"2022-03-15T05:50:12.666209+0000","last_undegraded":"2022-03-15T05:50:12.666209+0000","last_fullsized":"2022-03-15T05:50:12.666209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:54:20.464304+0000","stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279217+0000","last_change":"2022-03-15T05:50:02.277330+0000","last_active":"2022-03-15T05:50:02.279217+0000","last_peered":"2022-03-15T05:50:02.279217+0000","last_clean":"2022-03-15T05:50:02.279217+0000","last_became_active":"2022-03-15T05:50:02.276873+0000","last_became_peered":"2022-03-15T05:50:02.276873+0000","last_unstale":"2022-03-15T05:50:02.279217+0000","last_undegraded":"2022-03-15T05:50:02.279217+0000","last_fullsized":"2022-03-15T05:50:02.279217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:24:11.044313+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266707+0000","last_change":"2022-03-15T05:50:01.768784+0000","last_active":"2022-03-15T05:50:02.266707+0000","last_peered":"2022-03-15T05:50:02.266707+0000","last_clean":"2022-03-15T05:50:02.266707+0000","last_became_active":"2022-03-15T05:50:01.768446+0000","last_became_peered":"2022-03-15T05:50:01.768446+0000","last_unstale":"2022-03-15T05:50:02.266707+0000","last_undegraded":"2022-03-15T05:50:02.266707+0000","last_fullsized":"2022-03-15T05:50:02.266707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:17:30.808770+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285030+0000","last_change":"2022-03-15T05:50:02.279791+0000","last_active":"2022-03-15T05:50:02.285030+0000","last_peered":"2022-03-15T05:50:02.285030+0000","last_clean":"2022-03-15T05:50:02.285030+0000","last_became_active":"2022-03-15T05:50:02.279172+0000","last_became_peered":"2022-03-15T05:50:02.279172+0000","last_unstale":"2022-03-15T05:50:02.285030+0000","last_undegraded":"2022-03-15T05:50:02.285030+0000","last_fullsized":"2022-03-15T05:50:02.285030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:06:01.717047+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261139+0000","last_change":"2022-03-15T05:50:01.765934+0000","last_active":"2022-03-15T05:50:02.261139+0000","last_peered":"2022-03-15T05:50:02.261139+0000","last_clean":"2022-03-15T05:50:02.261139+0000","last_became_active":"2022-03-15T05:50:01.765593+0000","last_became_peered":"2022-03-15T05:50:01.765593+0000","last_unstale":"2022-03-15T05:50:02.261139+0000","last_undegraded":"2022-03-15T05:50:02.261139+0000","last_fullsized":"2022-03-15T05:50:02.261139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:17:58.343945+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273584+0000","last_change":"2022-03-15T05:50:02.271214+0000","last_active":"2022-03-15T05:50:02.273584+0000","last_peered":"2022-03-15T05:50:02.273584+0000","last_clean":"2022-03-15T05:50:02.273584+0000","last_became_active":"2022-03-15T05:50:02.270503+0000","last_became_peered":"2022-03-15T05:50:02.270503+0000","last_unstale":"2022-03-15T05:50:02.273584+0000","last_undegraded":"2022-03-15T05:50:02.273584+0000","last_fullsized":"2022-03-15T05:50:02.273584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:46:34.707474+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.266616+0000","last_change":"2022-03-15T05:50:01.760128+0000","last_active":"2022-03-15T05:50:07.266616+0000","last_peered":"2022-03-15T05:50:07.266616+0000","last_clean":"2022-03-15T05:50:07.266616+0000","last_became_active":"2022-03-15T05:50:01.759822+0000","last_became_peered":"2022-03-15T05:50:01.759822+0000","last_unstale":"2022-03-15T05:50:07.266616+0000","last_undegraded":"2022-03-15T05:50:07.266616+0000","last_fullsized":"2022-03-15T05:50:07.266616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:18:48.265357+0000","stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280983+0000","last_change":"2022-03-15T05:50:02.279712+0000","last_active":"2022-03-15T05:50:02.280983+0000","last_peered":"2022-03-15T05:50:02.280983+0000","last_clean":"2022-03-15T05:50:02.280983+0000","last_became_active":"2022-03-15T05:50:02.279212+0000","last_became_peered":"2022-03-15T05:50:02.279212+0000","last_unstale":"2022-03-15T05:50:02.280983+0000","last_undegraded":"2022-03-15T05:50:02.280983+0000","last_fullsized":"2022-03-15T05:50:02.280983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:19:44.101895+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:03.931263+0000","last_change":"2022-03-15T05:50:01.758101+0000","last_active":"2022-03-15T05:50:03.931263+0000","last_peered":"2022-03-15T05:50:03.931263+0000","last_clean":"2022-03-15T05:50:03.931263+0000","last_became_active":"2022-03-15T05:50:01.757825+0000","last_became_peered":"2022-03-15T05:50:01.757825+0000","last_unstale":"2022-03-15T05:50:03.931263+0000","last_undegraded":"2022-03-15T05:50:03.931263+0000","last_fullsized":"2022-03-15T05:50:03.931263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:17:42.303241+0000","stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281448+0000","last_change":"2022-03-15T05:50:02.267337+0000","last_active":"2022-03-15T05:50:02.281448+0000","last_peered":"2022-03-15T05:50:02.281448+0000","last_clean":"2022-03-15T05:50:02.281448+0000","last_became_active":"2022-03-15T05:50:02.267082+0000","last_became_peered":"2022-03-15T05:50:02.267082+0000","last_unstale":"2022-03-15T05:50:02.281448+0000","last_undegraded":"2022-03-15T05:50:02.281448+0000","last_fullsized":"2022-03-15T05:50:02.281448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:28:10.148060+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.265537+0000","last_change":"2022-03-15T05:50:01.766324+0000","last_active":"2022-03-15T05:50:07.265537+0000","last_peered":"2022-03-15T05:50:07.265537+0000","last_clean":"2022-03-15T05:50:07.265537+0000","last_became_active":"2022-03-15T05:50:01.766008+0000","last_became_peered":"2022-03-15T05:50:01.766008+0000","last_unstale":"2022-03-15T05:50:07.265537+0000","last_undegraded":"2022-03-15T05:50:07.265537+0000","last_fullsized":"2022-03-15T05:50:07.265537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:00:37.206705+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280289+0000","last_change":"2022-03-15T05:50:02.276334+0000","last_active":"2022-03-15T05:50:02.280289+0000","last_peered":"2022-03-15T05:50:02.280289+0000","last_clean":"2022-03-15T05:50:02.280289+0000","last_became_active":"2022-03-15T05:50:02.276030+0000","last_became_peered":"2022-03-15T05:50:02.276030+0000","last_unstale":"2022-03-15T05:50:02.280289+0000","last_undegraded":"2022-03-15T05:50:02.280289+0000","last_fullsized":"2022-03-15T05:50:02.280289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:24:56.245923+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:03.259992+0000","last_change":"2022-03-15T05:50:01.771270+0000","last_active":"2022-03-15T05:50:03.259992+0000","last_peered":"2022-03-15T05:50:03.259992+0000","last_clean":"2022-03-15T05:50:03.259992+0000","last_became_active":"2022-03-15T05:50:01.770985+0000","last_became_peered":"2022-03-15T05:50:01.770985+0000","last_unstale":"2022-03-15T05:50:03.259992+0000","last_undegraded":"2022-03-15T05:50:03.259992+0000","last_fullsized":"2022-03-15T05:50:03.259992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:28:26.138901+0000","stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277231+0000","last_change":"2022-03-15T05:50:02.270661+0000","last_active":"2022-03-15T05:50:02.277231+0000","last_peered":"2022-03-15T05:50:02.277231+0000","last_clean":"2022-03-15T05:50:02.277231+0000","last_became_active":"2022-03-15T05:50:02.270338+0000","last_became_peered":"2022-03-15T05:50:02.270338+0000","last_unstale":"2022-03-15T05:50:02.277231+0000","last_undegraded":"2022-03-15T05:50:02.277231+0000","last_fullsized":"2022-03-15T05:50:02.277231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:07:13.970018+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261651+0000","last_change":"2022-03-15T05:50:01.760891+0000","last_active":"2022-03-15T05:50:02.261651+0000","last_peered":"2022-03-15T05:50:02.261651+0000","last_clean":"2022-03-15T05:50:02.261651+0000","last_became_active":"2022-03-15T05:50:01.760552+0000","last_became_peered":"2022-03-15T05:50:01.760552+0000","last_unstale":"2022-03-15T05:50:02.261651+0000","last_undegraded":"2022-03-15T05:50:02.261651+0000","last_fullsized":"2022-03-15T05:50:02.261651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:10:36.649419+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278969+0000","last_change":"2022-03-15T05:50:02.277381+0000","last_active":"2022-03-15T05:50:02.278969+0000","last_peered":"2022-03-15T05:50:02.278969+0000","last_clean":"2022-03-15T05:50:02.278969+0000","last_became_active":"2022-03-15T05:50:02.277113+0000","last_became_peered":"2022-03-15T05:50:02.277113+0000","last_unstale":"2022-03-15T05:50:02.278969+0000","last_undegraded":"2022-03-15T05:50:02.278969+0000","last_fullsized":"2022-03-15T05:50:02.278969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:20:07.922465+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.263277+0000","last_change":"2022-03-15T05:50:01.757991+0000","last_active":"2022-03-15T05:50:07.263277+0000","last_peered":"2022-03-15T05:50:07.263277+0000","last_clean":"2022-03-15T05:50:07.263277+0000","last_became_active":"2022-03-15T05:50:01.757651+0000","last_became_peered":"2022-03-15T05:50:01.757651+0000","last_unstale":"2022-03-15T05:50:07.263277+0000","last_undegraded":"2022-03-15T05:50:07.263277+0000","last_fullsized":"2022-03-15T05:50:07.263277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:17:51.775038+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278650+0000","last_change":"2022-03-15T05:50:02.277017+0000","last_active":"2022-03-15T05:50:02.278650+0000","last_peered":"2022-03-15T05:50:02.278650+0000","last_clean":"2022-03-15T05:50:02.278650+0000","last_became_active":"2022-03-15T05:50:02.276718+0000","last_became_peered":"2022-03-15T05:50:02.276718+0000","last_unstale":"2022-03-15T05:50:02.278650+0000","last_undegraded":"2022-03-15T05:50:02.278650+0000","last_fullsized":"2022-03-15T05:50:02.278650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:56:31.659289+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261713+0000","last_change":"2022-03-15T05:50:01.764679+0000","last_active":"2022-03-15T05:50:02.261713+0000","last_peered":"2022-03-15T05:50:02.261713+0000","last_clean":"2022-03-15T05:50:02.261713+0000","last_became_active":"2022-03-15T05:50:01.761848+0000","last_became_peered":"2022-03-15T05:50:01.761848+0000","last_unstale":"2022-03-15T05:50:02.261713+0000","last_undegraded":"2022-03-15T05:50:02.261713+0000","last_fullsized":"2022-03-15T05:50:02.261713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:14:14.162973+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286066+0000","last_change":"2022-03-15T05:50:02.283961+0000","last_active":"2022-03-15T05:50:02.286066+0000","last_peered":"2022-03-15T05:50:02.286066+0000","last_clean":"2022-03-15T05:50:02.286066+0000","last_became_active":"2022-03-15T05:50:02.283237+0000","last_became_peered":"2022-03-15T05:50:02.283237+0000","last_unstale":"2022-03-15T05:50:02.286066+0000","last_undegraded":"2022-03-15T05:50:02.286066+0000","last_fullsized":"2022-03-15T05:50:02.286066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:42:49.764129+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"24'3","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:12.667319+0000","last_change":"2022-03-15T05:50:01.767200+0000","last_active":"2022-03-15T05:50:12.667319+0000","last_peered":"2022-03-15T05:50:12.667319+0000","last_clean":"2022-03-15T05:50:12.667319+0000","last_became_active":"2022-03-15T05:50:01.766581+0000","last_became_peered":"2022-03-15T05:50:01.766581+0000","last_unstale":"2022-03-15T05:50:12.667319+0000","last_undegraded":"2022-03-15T05:50:12.667319+0000","last_fullsized":"2022-03-15T05:50:12.667319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:58:11.088344+0000","stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275948+0000","last_change":"2022-03-15T05:50:02.270649+0000","last_active":"2022-03-15T05:50:02.275948+0000","last_peered":"2022-03-15T05:50:02.275948+0000","last_clean":"2022-03-15T05:50:02.275948+0000","last_became_active":"2022-03-15T05:50:02.270308+0000","last_became_peered":"2022-03-15T05:50:02.270308+0000","last_unstale":"2022-03-15T05:50:02.275948+0000","last_undegraded":"2022-03-15T05:50:02.275948+0000","last_fullsized":"2022-03-15T05:50:02.275948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:18:01.692755+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263279+0000","last_change":"2022-03-15T05:50:01.758464+0000","last_active":"2022-03-15T05:50:02.263279+0000","last_peered":"2022-03-15T05:50:02.263279+0000","last_clean":"2022-03-15T05:50:02.263279+0000","last_became_active":"2022-03-15T05:50:01.757936+0000","last_became_peered":"2022-03-15T05:50:01.757936+0000","last_unstale":"2022-03-15T05:50:02.263279+0000","last_undegraded":"2022-03-15T05:50:02.263279+0000","last_fullsized":"2022-03-15T05:50:02.263279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:44:19.373542+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278115+0000","last_change":"2022-03-15T05:50:02.270500+0000","last_active":"2022-03-15T05:50:02.278115+0000","last_peered":"2022-03-15T05:50:02.278115+0000","last_clean":"2022-03-15T05:50:02.278115+0000","last_became_active":"2022-03-15T05:50:02.270165+0000","last_became_peered":"2022-03-15T05:50:02.270165+0000","last_unstale":"2022-03-15T05:50:02.278115+0000","last_undegraded":"2022-03-15T05:50:02.278115+0000","last_fullsized":"2022-03-15T05:50:02.278115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:20:11.113002+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267755+0000","last_change":"2022-03-15T05:49:56.006265+0000","last_active":"2022-03-15T05:50:02.267755+0000","last_peered":"2022-03-15T05:50:02.267755+0000","last_clean":"2022-03-15T05:50:02.267755+0000","last_became_active":"2022-03-15T05:49:56.005945+0000","last_became_peered":"2022-03-15T05:49:56.005945+0000","last_unstale":"2022-03-15T05:50:02.267755+0000","last_undegraded":"2022-03-15T05:50:02.267755+0000","last_fullsized":"2022-03-15T05:50:02.267755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T05:59:10.545960+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:03.259409+0000","last_change":"2022-03-15T05:50:01.756552+0000","last_active":"2022-03-15T05:50:03.259409+0000","last_peered":"2022-03-15T05:50:03.259409+0000","last_clean":"2022-03-15T05:50:03.259409+0000","last_became_active":"2022-03-15T05:50:01.755731+0000","last_became_peered":"2022-03-15T05:50:01.755731+0000","last_unstale":"2022-03-15T05:50:03.259409+0000","last_undegraded":"2022-03-15T05:50:03.259409+0000","last_fullsized":"2022-03-15T05:50:03.259409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:20:06.863246+0000","stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277227+0000","last_change":"2022-03-15T05:50:02.271788+0000","last_active":"2022-03-15T05:50:02.277227+0000","last_peered":"2022-03-15T05:50:02.277227+0000","last_clean":"2022-03-15T05:50:02.277227+0000","last_became_active":"2022-03-15T05:50:02.271479+0000","last_became_peered":"2022-03-15T05:50:02.271479+0000","last_unstale":"2022-03-15T05:50:02.277227+0000","last_undegraded":"2022-03-15T05:50:02.277227+0000","last_fullsized":"2022-03-15T05:50:02.277227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:50:05.553818+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261866+0000","last_change":"2022-03-15T05:49:56.006179+0000","last_active":"2022-03-15T05:50:02.261866+0000","last_peered":"2022-03-15T05:50:02.261866+0000","last_clean":"2022-03-15T05:50:02.261866+0000","last_became_active":"2022-03-15T05:49:56.005909+0000","last_became_peered":"2022-03-15T05:49:56.005909+0000","last_unstale":"2022-03-15T05:50:02.261866+0000","last_undegraded":"2022-03-15T05:50:02.261866+0000","last_fullsized":"2022-03-15T05:50:02.261866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:24:44.215515+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.262943+0000","last_change":"2022-03-15T05:50:01.764346+0000","last_active":"2022-03-15T05:50:02.262943+0000","last_peered":"2022-03-15T05:50:02.262943+0000","last_clean":"2022-03-15T05:50:02.262943+0000","last_became_active":"2022-03-15T05:50:01.763997+0000","last_became_peered":"2022-03-15T05:50:01.763997+0000","last_unstale":"2022-03-15T05:50:02.262943+0000","last_undegraded":"2022-03-15T05:50:02.262943+0000","last_fullsized":"2022-03-15T05:50:02.262943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:50:52.655627+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279198+0000","last_change":"2022-03-15T05:50:02.276942+0000","last_active":"2022-03-15T05:50:02.279198+0000","last_peered":"2022-03-15T05:50:02.279198+0000","last_clean":"2022-03-15T05:50:02.279198+0000","last_became_active":"2022-03-15T05:50:02.276353+0000","last_became_peered":"2022-03-15T05:50:02.276353+0000","last_unstale":"2022-03-15T05:50:02.279198+0000","last_undegraded":"2022-03-15T05:50:02.279198+0000","last_fullsized":"2022-03-15T05:50:02.279198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:30:47.020786+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.259035+0000","last_change":"2022-03-15T05:49:55.717507+0000","last_active":"2022-03-15T05:50:02.259035+0000","last_peered":"2022-03-15T05:50:02.259035+0000","last_clean":"2022-03-15T05:50:02.259035+0000","last_became_active":"2022-03-15T05:49:55.717125+0000","last_became_peered":"2022-03-15T05:49:55.717125+0000","last_unstale":"2022-03-15T05:50:02.259035+0000","last_undegraded":"2022-03-15T05:50:02.259035+0000","last_fullsized":"2022-03-15T05:50:02.259035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:01:26.511571+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266522+0000","last_change":"2022-03-15T05:50:01.756925+0000","last_active":"2022-03-15T05:50:02.266522+0000","last_peered":"2022-03-15T05:50:02.266522+0000","last_clean":"2022-03-15T05:50:02.266522+0000","last_became_active":"2022-03-15T05:50:01.756195+0000","last_became_peered":"2022-03-15T05:50:01.756195+0000","last_unstale":"2022-03-15T05:50:02.266522+0000","last_undegraded":"2022-03-15T05:50:02.266522+0000","last_fullsized":"2022-03-15T05:50:02.266522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:37:07.377792+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277317+0000","last_change":"2022-03-15T05:50:02.272291+0000","last_active":"2022-03-15T05:50:02.277317+0000","last_peered":"2022-03-15T05:50:02.277317+0000","last_clean":"2022-03-15T05:50:02.277317+0000","last_became_active":"2022-03-15T05:50:02.271963+0000","last_became_peered":"2022-03-15T05:50:02.271963+0000","last_unstale":"2022-03-15T05:50:02.277317+0000","last_undegraded":"2022-03-15T05:50:02.277317+0000","last_fullsized":"2022-03-15T05:50:02.277317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:39:02.228387+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.264335+0000","last_change":"2022-03-15T05:49:55.714924+0000","last_active":"2022-03-15T05:50:02.264335+0000","last_peered":"2022-03-15T05:50:02.264335+0000","last_clean":"2022-03-15T05:50:02.264335+0000","last_became_active":"2022-03-15T05:49:55.714704+0000","last_became_peered":"2022-03-15T05:49:55.714704+0000","last_unstale":"2022-03-15T05:50:02.264335+0000","last_undegraded":"2022-03-15T05:50:02.264335+0000","last_fullsized":"2022-03-15T05:50:02.264335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:17:23.776392+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261862+0000","last_change":"2022-03-15T05:49:48.418992+0000","last_active":"2022-03-15T05:50:02.261862+0000","last_peered":"2022-03-15T05:50:02.261862+0000","last_clean":"2022-03-15T05:50:02.261862+0000","last_became_active":"2022-03-15T05:49:48.417864+0000","last_became_peered":"2022-03-15T05:49:48.417864+0000","last_unstale":"2022-03-15T05:50:02.261862+0000","last_undegraded":"2022-03-15T05:50:02.261862+0000","last_fullsized":"2022-03-15T05:50:02.261862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:47.305366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:47.305366+0000","last_clean_scrub_stamp":"2022-03-15T05:49:47.305366+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:06:48.812663+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.265735+0000","last_change":"2022-03-15T05:50:01.768622+0000","last_active":"2022-03-15T05:50:02.265735+0000","last_peered":"2022-03-15T05:50:02.265735+0000","last_clean":"2022-03-15T05:50:02.265735+0000","last_became_active":"2022-03-15T05:50:01.768270+0000","last_became_peered":"2022-03-15T05:50:01.768270+0000","last_unstale":"2022-03-15T05:50:02.265735+0000","last_undegraded":"2022-03-15T05:50:02.265735+0000","last_fullsized":"2022-03-15T05:50:02.265735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:53:03.610048+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286021+0000","last_change":"2022-03-15T05:50:02.283485+0000","last_active":"2022-03-15T05:50:02.286021+0000","last_peered":"2022-03-15T05:50:02.286021+0000","last_clean":"2022-03-15T05:50:02.286021+0000","last_became_active":"2022-03-15T05:50:02.282868+0000","last_became_peered":"2022-03-15T05:50:02.282868+0000","last_unstale":"2022-03-15T05:50:02.286021+0000","last_undegraded":"2022-03-15T05:50:02.286021+0000","last_fullsized":"2022-03-15T05:50:02.286021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:41:46.412779+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261606+0000","last_change":"2022-03-15T05:49:55.717054+0000","last_active":"2022-03-15T05:50:02.261606+0000","last_peered":"2022-03-15T05:50:02.261606+0000","last_clean":"2022-03-15T05:50:02.261606+0000","last_became_active":"2022-03-15T05:49:55.716665+0000","last_became_peered":"2022-03-15T05:49:55.716665+0000","last_unstale":"2022-03-15T05:50:02.261606+0000","last_undegraded":"2022-03-15T05:50:02.261606+0000","last_fullsized":"2022-03-15T05:50:02.261606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:39:40.811968+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263842+0000","last_change":"2022-03-15T05:50:01.759408+0000","last_active":"2022-03-15T05:50:02.263842+0000","last_peered":"2022-03-15T05:50:02.263842+0000","last_clean":"2022-03-15T05:50:02.263842+0000","last_became_active":"2022-03-15T05:50:01.759087+0000","last_became_peered":"2022-03-15T05:50:01.759087+0000","last_unstale":"2022-03-15T05:50:02.263842+0000","last_undegraded":"2022-03-15T05:50:02.263842+0000","last_fullsized":"2022-03-15T05:50:02.263842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:16:33.815600+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273561+0000","last_change":"2022-03-15T05:50:02.270677+0000","last_active":"2022-03-15T05:50:02.273561+0000","last_peered":"2022-03-15T05:50:02.273561+0000","last_clean":"2022-03-15T05:50:02.273561+0000","last_became_active":"2022-03-15T05:50:02.270124+0000","last_became_peered":"2022-03-15T05:50:02.270124+0000","last_unstale":"2022-03-15T05:50:02.273561+0000","last_undegraded":"2022-03-15T05:50:02.273561+0000","last_fullsized":"2022-03-15T05:50:02.273561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:08:06.976250+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.264706+0000","last_change":"2022-03-15T05:49:55.717051+0000","last_active":"2022-03-15T05:50:02.264706+0000","last_peered":"2022-03-15T05:50:02.264706+0000","last_clean":"2022-03-15T05:50:02.264706+0000","last_became_active":"2022-03-15T05:49:55.716645+0000","last_became_peered":"2022-03-15T05:49:55.716645+0000","last_unstale":"2022-03-15T05:50:02.264706+0000","last_undegraded":"2022-03-15T05:50:02.264706+0000","last_fullsized":"2022-03-15T05:50:02.264706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:30:50.088264+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.265664+0000","last_change":"2022-03-15T05:50:01.751284+0000","last_active":"2022-03-15T05:50:02.265664+0000","last_peered":"2022-03-15T05:50:02.265664+0000","last_clean":"2022-03-15T05:50:02.265664+0000","last_became_active":"2022-03-15T05:50:01.750703+0000","last_became_peered":"2022-03-15T05:50:01.750703+0000","last_unstale":"2022-03-15T05:50:02.265664+0000","last_undegraded":"2022-03-15T05:50:02.265664+0000","last_fullsized":"2022-03-15T05:50:02.265664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:38:23.932929+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277357+0000","last_change":"2022-03-15T05:50:02.272088+0000","last_active":"2022-03-15T05:50:02.277357+0000","last_peered":"2022-03-15T05:50:02.277357+0000","last_clean":"2022-03-15T05:50:02.277357+0000","last_became_active":"2022-03-15T05:50:02.271791+0000","last_became_peered":"2022-03-15T05:50:02.271791+0000","last_unstale":"2022-03-15T05:50:02.277357+0000","last_undegraded":"2022-03-15T05:50:02.277357+0000","last_fullsized":"2022-03-15T05:50:02.277357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:47:55.992221+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.260087+0000","last_change":"2022-03-15T05:50:01.760181+0000","last_active":"2022-03-15T05:50:07.260087+0000","last_peered":"2022-03-15T05:50:07.260087+0000","last_clean":"2022-03-15T05:50:07.260087+0000","last_became_active":"2022-03-15T05:50:01.758933+0000","last_became_peered":"2022-03-15T05:50:01.758933+0000","last_unstale":"2022-03-15T05:50:07.260087+0000","last_undegraded":"2022-03-15T05:50:07.260087+0000","last_fullsized":"2022-03-15T05:50:07.260087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:07:34.261671+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266242+0000","last_change":"2022-03-15T05:49:56.021984+0000","last_active":"2022-03-15T05:50:02.266242+0000","last_peered":"2022-03-15T05:50:02.266242+0000","last_clean":"2022-03-15T05:50:02.266242+0000","last_became_active":"2022-03-15T05:49:56.021731+0000","last_became_peered":"2022-03-15T05:49:56.021731+0000","last_unstale":"2022-03-15T05:50:02.266242+0000","last_undegraded":"2022-03-15T05:50:02.266242+0000","last_fullsized":"2022-03-15T05:50:02.266242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:28:10.949766+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284752+0000","last_change":"2022-03-15T05:50:02.283078+0000","last_active":"2022-03-15T05:50:02.284752+0000","last_peered":"2022-03-15T05:50:02.284752+0000","last_clean":"2022-03-15T05:50:02.284752+0000","last_became_active":"2022-03-15T05:50:02.282773+0000","last_became_peered":"2022-03-15T05:50:02.282773+0000","last_unstale":"2022-03-15T05:50:02.284752+0000","last_undegraded":"2022-03-15T05:50:02.284752+0000","last_fullsized":"2022-03-15T05:50:02.284752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:30:20.154884+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261311+0000","last_change":"2022-03-15T05:49:56.021748+0000","last_active":"2022-03-15T05:50:02.261311+0000","last_peered":"2022-03-15T05:50:02.261311+0000","last_clean":"2022-03-15T05:50:02.261311+0000","last_became_active":"2022-03-15T05:49:56.021377+0000","last_became_peered":"2022-03-15T05:49:56.021377+0000","last_unstale":"2022-03-15T05:50:02.261311+0000","last_undegraded":"2022-03-15T05:50:02.261311+0000","last_fullsized":"2022-03-15T05:50:02.261311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:26:22.203948+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266443+0000","last_change":"2022-03-15T05:50:01.758476+0000","last_active":"2022-03-15T05:50:02.266443+0000","last_peered":"2022-03-15T05:50:02.266443+0000","last_clean":"2022-03-15T05:50:02.266443+0000","last_became_active":"2022-03-15T05:50:01.757859+0000","last_became_peered":"2022-03-15T05:50:01.757859+0000","last_unstale":"2022-03-15T05:50:02.266443+0000","last_undegraded":"2022-03-15T05:50:02.266443+0000","last_fullsized":"2022-03-15T05:50:02.266443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:18:49.740446+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279752+0000","last_change":"2022-03-15T05:50:02.271202+0000","last_active":"2022-03-15T05:50:02.279752+0000","last_peered":"2022-03-15T05:50:02.279752+0000","last_clean":"2022-03-15T05:50:02.279752+0000","last_became_active":"2022-03-15T05:50:02.270717+0000","last_became_peered":"2022-03-15T05:50:02.270717+0000","last_unstale":"2022-03-15T05:50:02.279752+0000","last_undegraded":"2022-03-15T05:50:02.279752+0000","last_fullsized":"2022-03-15T05:50:02.279752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:57:17.654890+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:04.344705+0000","last_change":"2022-03-15T05:50:01.768300+0000","last_active":"2022-03-15T05:50:04.344705+0000","last_peered":"2022-03-15T05:50:04.344705+0000","last_clean":"2022-03-15T05:50:04.344705+0000","last_became_active":"2022-03-15T05:50:01.767955+0000","last_became_peered":"2022-03-15T05:50:01.767955+0000","last_unstale":"2022-03-15T05:50:04.344705+0000","last_undegraded":"2022-03-15T05:50:04.344705+0000","last_fullsized":"2022-03-15T05:50:04.344705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:10:41.738813+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280244+0000","last_change":"2022-03-15T05:50:02.276173+0000","last_active":"2022-03-15T05:50:02.280244+0000","last_peered":"2022-03-15T05:50:02.280244+0000","last_clean":"2022-03-15T05:50:02.280244+0000","last_became_active":"2022-03-15T05:50:02.275805+0000","last_became_peered":"2022-03-15T05:50:02.275805+0000","last_unstale":"2022-03-15T05:50:02.280244+0000","last_undegraded":"2022-03-15T05:50:02.280244+0000","last_fullsized":"2022-03-15T05:50:02.280244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:20:32.284452+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.266612+0000","last_change":"2022-03-15T05:50:01.769303+0000","last_active":"2022-03-15T05:50:07.266612+0000","last_peered":"2022-03-15T05:50:07.266612+0000","last_clean":"2022-03-15T05:50:07.266612+0000","last_became_active":"2022-03-15T05:50:01.768420+0000","last_became_peered":"2022-03-15T05:50:01.768420+0000","last_unstale":"2022-03-15T05:50:07.266612+0000","last_undegraded":"2022-03-15T05:50:07.266612+0000","last_fullsized":"2022-03-15T05:50:07.266612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:52:53.780299+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275161+0000","last_change":"2022-03-15T05:50:02.269010+0000","last_active":"2022-03-15T05:50:02.275161+0000","last_peered":"2022-03-15T05:50:02.275161+0000","last_clean":"2022-03-15T05:50:02.275161+0000","last_became_active":"2022-03-15T05:50:02.268702+0000","last_became_peered":"2022-03-15T05:50:02.268702+0000","last_unstale":"2022-03-15T05:50:02.275161+0000","last_undegraded":"2022-03-15T05:50:02.275161+0000","last_fullsized":"2022-03-15T05:50:02.275161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:21:36.546324+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.265743+0000","last_change":"2022-03-15T05:50:01.769060+0000","last_active":"2022-03-15T05:50:07.265743+0000","last_peered":"2022-03-15T05:50:07.265743+0000","last_clean":"2022-03-15T05:50:07.265743+0000","last_became_active":"2022-03-15T05:50:01.768832+0000","last_became_peered":"2022-03-15T05:50:01.768832+0000","last_unstale":"2022-03-15T05:50:07.265743+0000","last_undegraded":"2022-03-15T05:50:07.265743+0000","last_fullsized":"2022-03-15T05:50:07.265743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:08:34.598986+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277210+0000","last_change":"2022-03-15T05:50:02.269955+0000","last_active":"2022-03-15T05:50:02.277210+0000","last_peered":"2022-03-15T05:50:02.277210+0000","last_clean":"2022-03-15T05:50:02.277210+0000","last_became_active":"2022-03-15T05:50:02.268808+0000","last_became_peered":"2022-03-15T05:50:02.268808+0000","last_unstale":"2022-03-15T05:50:02.277210+0000","last_undegraded":"2022-03-15T05:50:02.277210+0000","last_fullsized":"2022-03-15T05:50:02.277210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:42:50.905588+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:04.172060+0000","last_change":"2022-03-15T05:50:01.758736+0000","last_active":"2022-03-15T05:50:04.172060+0000","last_peered":"2022-03-15T05:50:04.172060+0000","last_clean":"2022-03-15T05:50:04.172060+0000","last_became_active":"2022-03-15T05:50:01.758333+0000","last_became_peered":"2022-03-15T05:50:01.758333+0000","last_unstale":"2022-03-15T05:50:04.172060+0000","last_undegraded":"2022-03-15T05:50:04.172060+0000","last_fullsized":"2022-03-15T05:50:04.172060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:58:43.148420+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277947+0000","last_change":"2022-03-15T05:50:02.269606+0000","last_active":"2022-03-15T05:50:02.277947+0000","last_peered":"2022-03-15T05:50:02.277947+0000","last_clean":"2022-03-15T05:50:02.277947+0000","last_became_active":"2022-03-15T05:50:02.268919+0000","last_became_peered":"2022-03-15T05:50:02.268919+0000","last_unstale":"2022-03-15T05:50:02.277947+0000","last_undegraded":"2022-03-15T05:50:02.277947+0000","last_fullsized":"2022-03-15T05:50:02.277947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:07:44.276834+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.264391+0000","last_change":"2022-03-15T05:50:01.756439+0000","last_active":"2022-03-15T05:50:07.264391+0000","last_peered":"2022-03-15T05:50:07.264391+0000","last_clean":"2022-03-15T05:50:07.264391+0000","last_became_active":"2022-03-15T05:50:01.756088+0000","last_became_peered":"2022-03-15T05:50:01.756088+0000","last_unstale":"2022-03-15T05:50:07.264391+0000","last_undegraded":"2022-03-15T05:50:07.264391+0000","last_fullsized":"2022-03-15T05:50:07.264391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:46:26.623500+0000","stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275939+0000","last_change":"2022-03-15T05:50:02.271501+0000","last_active":"2022-03-15T05:50:02.275939+0000","last_peered":"2022-03-15T05:50:02.275939+0000","last_clean":"2022-03-15T05:50:02.275939+0000","last_became_active":"2022-03-15T05:50:02.271187+0000","last_became_peered":"2022-03-15T05:50:02.271187+0000","last_unstale":"2022-03-15T05:50:02.275939+0000","last_undegraded":"2022-03-15T05:50:02.275939+0000","last_fullsized":"2022-03-15T05:50:02.275939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:54:59.344451+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279026+0000","last_change":"2022-03-15T05:50:02.274406+0000","last_active":"2022-03-15T05:50:02.279026+0000","last_peered":"2022-03-15T05:50:02.279026+0000","last_clean":"2022-03-15T05:50:02.279026+0000","last_became_active":"2022-03-15T05:50:02.274125+0000","last_became_peered":"2022-03-15T05:50:02.274125+0000","last_unstale":"2022-03-15T05:50:02.279026+0000","last_undegraded":"2022-03-15T05:50:02.279026+0000","last_fullsized":"2022-03-15T05:50:02.279026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:29:08.737054+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277189+0000","last_change":"2022-03-15T05:50:02.272438+0000","last_active":"2022-03-15T05:50:02.277189+0000","last_peered":"2022-03-15T05:50:02.277189+0000","last_clean":"2022-03-15T05:50:02.277189+0000","last_became_active":"2022-03-15T05:50:02.272170+0000","last_became_peered":"2022-03-15T05:50:02.272170+0000","last_unstale":"2022-03-15T05:50:02.277189+0000","last_undegraded":"2022-03-15T05:50:02.277189+0000","last_fullsized":"2022-03-15T05:50:02.277189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:48:35.986901+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.287816+0000","last_change":"2022-03-15T05:50:02.283839+0000","last_active":"2022-03-15T05:50:02.287816+0000","last_peered":"2022-03-15T05:50:02.287816+0000","last_clean":"2022-03-15T05:50:02.287816+0000","last_became_active":"2022-03-15T05:50:02.283609+0000","last_became_peered":"2022-03-15T05:50:02.283609+0000","last_unstale":"2022-03-15T05:50:02.287816+0000","last_undegraded":"2022-03-15T05:50:02.287816+0000","last_fullsized":"2022-03-15T05:50:02.287816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:12:07.158629+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280963+0000","last_change":"2022-03-15T05:50:02.279440+0000","last_active":"2022-03-15T05:50:02.280963+0000","last_peered":"2022-03-15T05:50:02.280963+0000","last_clean":"2022-03-15T05:50:02.280963+0000","last_became_active":"2022-03-15T05:50:02.279161+0000","last_became_peered":"2022-03-15T05:50:02.279161+0000","last_unstale":"2022-03-15T05:50:02.280963+0000","last_undegraded":"2022-03-15T05:50:02.280963+0000","last_fullsized":"2022-03-15T05:50:02.280963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:51:31.533566+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.271955+0000","last_change":"2022-03-15T05:50:02.269218+0000","last_active":"2022-03-15T05:50:02.271955+0000","last_peered":"2022-03-15T05:50:02.271955+0000","last_clean":"2022-03-15T05:50:02.271955+0000","last_became_active":"2022-03-15T05:50:02.268768+0000","last_became_peered":"2022-03-15T05:50:02.268768+0000","last_unstale":"2022-03-15T05:50:02.271955+0000","last_undegraded":"2022-03-15T05:50:02.271955+0000","last_fullsized":"2022-03-15T05:50:02.271955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:17:44.234889+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2442,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":93616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7940,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363900,"statfs":{"total":96636764160,"available":96628633600,"internally_reserved":0,"allocated":258048,"data_stored":93512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7970000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8260000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6880000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7349999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8972,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94362868,"statfs":{"total":96636764160,"available":96627576832,"internally_reserved":0,"allocated":790528,"data_stored":621550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8004,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363836,"statfs":{"total":96636764160,"available":96628568064,"internally_reserved":0,"allocated":258048,"data_stored":92110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":91964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":91964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":778240,"data_stored":619799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4830000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":90395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-03-15T05:50:14.867 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2022-03-15T05:50:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.070+0000 7ff06eec3700 1 Processor -- start 2022-03-15T05:50:15.072 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.070+0000 7ff06eec3700 1 -- start start 2022-03-15T05:50:15.074 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.071+0000 7ff06eec3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff06814ec60 0x7ff0680c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.075 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.071+0000 7ff06eec3700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff0680c57e0 0x7ff0680c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.075 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.071+0000 7ff06eec3700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff068068310 con 0x7ff068069810 2022-03-15T05:50:15.075 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.071+0000 7ff06eec3700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0680691d0 con 0x7ff0680c57e0 2022-03-15T05:50:15.075 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.071+0000 7ff06eec3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0680c4400 con 0x7ff06814ec60 2022-03-15T05:50:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.071+0000 7ff06dec1700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff06814ec60 0x7ff0680c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06d6c0700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7ff068069810 0x7ff068157e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33684/0 (socket says 172.21.15.151:33684) 2022-03-15T05:50:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06d6c0700 1 -- 172.21.15.151:0/795569126 learned_addr learned my addr 172.21.15.151:0/795569126 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:15.076 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06e6c2700 1 --2- 172.21.15.151:0/795569126 >> v2:172.21.15.164:3300/0 conn(0x7ff0680c57e0 0x7ff0680c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.077 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06cebf700 1 -- 172.21.15.151:0/795569126 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577978255 0 0) 0x7ff058001110 con 0x7ff068069810 2022-03-15T05:50:15.077 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06cebf700 1 -- 172.21.15.151:0/795569126 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0500033f0 con 0x7ff068069810 2022-03-15T05:50:15.077 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06dec1700 1 -- 172.21.15.151:0/795569126 >> v2:172.21.15.164:3300/0 conn(0x7ff0680c57e0 msgr2=0x7ff0680c5c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:15.077 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06dec1700 1 --2- 172.21.15.151:0/795569126 >> v2:172.21.15.164:3300/0 conn(0x7ff0680c57e0 0x7ff0680c5c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.077 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06dec1700 1 -- 172.21.15.151:0/795569126 >> v1:172.21.15.164:6789/0 conn(0x7ff068069810 legacy=0x7ff068157e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06dec1700 1 -- 172.21.15.151:0/795569126 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff068067a90 con 0x7ff06814ec60 2022-03-15T05:50:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06e6c2700 1 --2- 172.21.15.151:0/795569126 >> v2:172.21.15.164:3300/0 conn(0x7ff0680c57e0 0x7ff0680c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.072+0000 7ff06dec1700 1 --2- 172.21.15.151:0/795569126 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff06814ec60 0x7ff0680c4de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff064009760 tx=0x7ff064009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c1da2edaaf2fc6b server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:15.078 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06cebf700 1 -- 172.21.15.151:0/795569126 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0640105b0 con 0x7ff06814ec60 2022-03-15T05:50:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06cebf700 1 -- 172.21.15.151:0/795569126 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff064010710 con 0x7ff06814ec60 2022-03-15T05:50:15.079 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06cebf700 1 -- 172.21.15.151:0/795569126 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff064010a90 con 0x7ff06814ec60 2022-03-15T05:50:15.082 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06eec3700 1 -- 172.21.15.151:0/795569126 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff06814ec60 msgr2=0x7ff0680c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.082 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06eec3700 1 --2- 172.21.15.151:0/795569126 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff06814ec60 0x7ff0680c4de0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff064009760 tx=0x7ff064009060 comp rx=0 tx=0).stop 2022-03-15T05:50:15.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06eec3700 1 -- 172.21.15.151:0/795569126 shutdown_connections 2022-03-15T05:50:15.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06eec3700 1 --2- 172.21.15.151:0/795569126 >> v2:172.21.15.164:3300/0 conn(0x7ff0680c57e0 0x7ff0680c5c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06eec3700 1 --2- 172.21.15.151:0/795569126 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff06814ec60 0x7ff0680c4de0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06eec3700 1 -- 172.21.15.151:0/795569126 >> 172.21.15.151:0/795569126 conn(0x7ff068062490 msgr2=0x7ff068062890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:15.084 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06eec3700 1 -- 172.21.15.151:0/795569126 shutdown_connections 2022-03-15T05:50:15.084 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.073+0000 7ff06eec3700 1 -- 172.21.15.151:0/795569126 wait complete. 2022-03-15T05:50:15.084 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.076+0000 7ff06eec3700 1 Processor -- start 2022-03-15T05:50:15.084 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.076+0000 7ff06eec3700 1 -- start start 2022-03-15T05:50:15.084 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.077+0000 7ff06eec3700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff068069810 0x7ff068165a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.085 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.077+0000 7ff06eec3700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0680c57e0 0x7ff068168e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.085 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.077+0000 7ff06eec3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff06814ec60 0x7ff068151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.085 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.077+0000 7ff06eec3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068149450 con 0x7ff06814ec60 2022-03-15T05:50:15.085 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.077+0000 7ff06eec3700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff068153d20 con 0x7ff068069810 2022-03-15T05:50:15.085 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.077+0000 7ff06eec3700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0681655d0 con 0x7ff0680c57e0 2022-03-15T05:50:15.086 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.077+0000 7ff06d6c0700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0680c57e0 0x7ff068168e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.086 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.077+0000 7ff06dec1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff068069810 0x7ff068165a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.086 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06dec1700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff068069810 0x7ff068165a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57322/0 (socket says 172.21.15.151:57322) 2022-03-15T05:50:15.086 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06dec1700 1 -- 172.21.15.151:0/956856774 learned_addr learned my addr 172.21.15.151:0/956856774 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:15.087 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06e6c2700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff06814ec60 0x7ff068151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.087 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06d6c0700 1 -- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff068069810 msgr2=0x7ff068165a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.087 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06d6c0700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff068069810 0x7ff068165a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.087 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06d6c0700 1 -- 172.21.15.151:0/956856774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff06814ec60 msgr2=0x7ff068151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.088 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06d6c0700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff06814ec60 0x7ff068151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.088 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06d6c0700 1 -- 172.21.15.151:0/956856774 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff060009a20 con 0x7ff0680c57e0 2022-03-15T05:50:15.088 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06dec1700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff068069810 0x7ff068165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:15.088 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06e6c2700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff06814ec60 0x7ff068151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:15.088 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff06d6c0700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0680c57e0 0x7ff068168e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff05800c410 tx=0x7ff058007a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:15.089 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.078+0000 7ff055ffb700 1 -- 172.21.15.151:0/956856774 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0580070d0 con 0x7ff0680c57e0 2022-03-15T05:50:15.089 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.079+0000 7ff055ffb700 1 -- 172.21.15.151:0/956856774 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff058007230 con 0x7ff0680c57e0 2022-03-15T05:50:15.089 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.079+0000 7ff055ffb700 1 -- 172.21.15.151:0/956856774 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0580075f0 con 0x7ff0680c57e0 2022-03-15T05:50:15.089 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.079+0000 7ff06eec3700 1 -- 172.21.15.151:0/956856774 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0640092a0 con 0x7ff0680c57e0 2022-03-15T05:50:15.089 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.079+0000 7ff06eec3700 1 -- 172.21.15.151:0/956856774 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff068150150 con 0x7ff0680c57e0 2022-03-15T05:50:15.090 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.080+0000 7ff06eec3700 1 -- 172.21.15.151:0/956856774 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff068165760 con 0x7ff0680c57e0 2022-03-15T05:50:15.091 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.081+0000 7ff055ffb700 1 -- 172.21.15.151:0/956856774 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7ff058019030 con 0x7ff0680c57e0 2022-03-15T05:50:15.091 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.081+0000 7ff055ffb700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff0480633c0 0x7ff048065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.091 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.082+0000 7ff055ffb700 1 -- 172.21.15.151:0/956856774 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff05807ebe0 con 0x7ff0680c57e0 2022-03-15T05:50:15.091 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.082+0000 7ff06dec1700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff0480633c0 0x7ff048065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.092 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.083+0000 7ff06dec1700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff0480633c0 0x7ff048065870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff064006c00 tx=0x7ff064016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:15.092 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.085+0000 7ff055ffb700 1 -- 172.21.15.151:0/956856774 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7ff05804ddd0 con 0x7ff0680c57e0 2022-03-15T05:50:15.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.266+0000 7ff06eec3700 1 -- 172.21.15.151:0/956856774 --> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff068068310 con 0x7ff0480633c0 2022-03-15T05:50:15.276 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.274+0000 7ff055ffb700 1 -- 172.21.15.151:0/956856774 <== mgr.4111 v2:172.21.15.164:6832/40466 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278276 (secure 0 0 0) 0x7ff068068310 con 0x7ff0480633c0 2022-03-15T05:50:15.280 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:15.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.278+0000 7ff06eec3700 1 -- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff0480633c0 msgr2=0x7ff048065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.278+0000 7ff06eec3700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff0480633c0 0x7ff048065870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff064006c00 tx=0x7ff064016000 comp rx=0 tx=0).stop 2022-03-15T05:50:15.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.278+0000 7ff06eec3700 1 -- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0680c57e0 msgr2=0x7ff068168e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.284 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.278+0000 7ff06eec3700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0680c57e0 0x7ff068168e40 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff05800c410 tx=0x7ff058007a30 comp rx=0 tx=0).stop 2022-03-15T05:50:15.284 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.279+0000 7ff06eec3700 1 -- 172.21.15.151:0/956856774 shutdown_connections 2022-03-15T05:50:15.284 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.279+0000 7ff06eec3700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff0480633c0 0x7ff048065870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.284 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.279+0000 7ff06eec3700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff06814ec60 0x7ff068151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.285 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.279+0000 7ff06eec3700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff068069810 0x7ff068165a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.285 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.279+0000 7ff06eec3700 1 --2- 172.21.15.151:0/956856774 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff0680c57e0 0x7ff068168e40 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.285 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.279+0000 7ff06eec3700 1 -- 172.21.15.151:0/956856774 >> 172.21.15.151:0/956856774 conn(0x7ff068062490 msgr2=0x7ff0680c4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:15.285 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.279+0000 7ff06eec3700 1 -- 172.21.15.151:0/956856774 shutdown_connections 2022-03-15T05:50:15.285 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.279+0000 7ff06eec3700 1 -- 172.21.15.151:0/956856774 wait complete. 2022-03-15T05:50:15.286 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2022-03-15T05:50:15.305 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2022-03-15T05:50:14.652032+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592810,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":217,"num_write_kb":2432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":165,"ondisk_log_size":165,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":65672,"kb_used_data":3016,"kb_used_omap":0,"kb_used_meta":62592,"kb_avail":754909048,"statfs":{"total":773094113280,"available":773026865152,"internally_reserved":0,"allocated":3088384,"data_stored":1794910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64094208},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2442,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.394862"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273754+0000","last_change":"2022-03-15T05:50:02.270526+0000","last_active":"2022-03-15T05:50:02.273754+0000","last_peered":"2022-03-15T05:50:02.273754+0000","last_clean":"2022-03-15T05:50:02.273754+0000","last_became_active":"2022-03-15T05:50:02.270047+0000","last_became_peered":"2022-03-15T05:50:02.270047+0000","last_unstale":"2022-03-15T05:50:02.273754+0000","last_undegraded":"2022-03-15T05:50:02.273754+0000","last_fullsized":"2022-03-15T05:50:02.273754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:19:07.916578+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275970+0000","last_change":"2022-03-15T05:50:02.272082+0000","last_active":"2022-03-15T05:50:02.275970+0000","last_peered":"2022-03-15T05:50:02.275970+0000","last_clean":"2022-03-15T05:50:02.275970+0000","last_became_active":"2022-03-15T05:50:02.271830+0000","last_became_peered":"2022-03-15T05:50:02.271830+0000","last_unstale":"2022-03-15T05:50:02.275970+0000","last_undegraded":"2022-03-15T05:50:02.275970+0000","last_fullsized":"2022-03-15T05:50:02.275970+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:11:22.661539+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277940+0000","last_change":"2022-03-15T05:50:02.274527+0000","last_active":"2022-03-15T05:50:02.277940+0000","last_peered":"2022-03-15T05:50:02.277940+0000","last_clean":"2022-03-15T05:50:02.277940+0000","last_became_active":"2022-03-15T05:50:02.274276+0000","last_became_peered":"2022-03-15T05:50:02.274276+0000","last_unstale":"2022-03-15T05:50:02.277940+0000","last_undegraded":"2022-03-15T05:50:02.277940+0000","last_fullsized":"2022-03-15T05:50:02.277940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:30:36.811134+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278491+0000","last_change":"2022-03-15T05:50:02.273391+0000","last_active":"2022-03-15T05:50:02.278491+0000","last_peered":"2022-03-15T05:50:02.278491+0000","last_clean":"2022-03-15T05:50:02.278491+0000","last_became_active":"2022-03-15T05:50:02.273048+0000","last_became_peered":"2022-03-15T05:50:02.273048+0000","last_unstale":"2022-03-15T05:50:02.278491+0000","last_undegraded":"2022-03-15T05:50:02.278491+0000","last_fullsized":"2022-03-15T05:50:02.278491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:29:30.963367+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279283+0000","last_change":"2022-03-15T05:50:02.275876+0000","last_active":"2022-03-15T05:50:02.279283+0000","last_peered":"2022-03-15T05:50:02.279283+0000","last_clean":"2022-03-15T05:50:02.279283+0000","last_became_active":"2022-03-15T05:50:02.275568+0000","last_became_peered":"2022-03-15T05:50:02.275568+0000","last_unstale":"2022-03-15T05:50:02.279283+0000","last_undegraded":"2022-03-15T05:50:02.279283+0000","last_fullsized":"2022-03-15T05:50:02.279283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:49:14.636242+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285627+0000","last_change":"2022-03-15T05:50:02.280155+0000","last_active":"2022-03-15T05:50:02.285627+0000","last_peered":"2022-03-15T05:50:02.285627+0000","last_clean":"2022-03-15T05:50:02.285627+0000","last_became_active":"2022-03-15T05:50:02.279866+0000","last_became_peered":"2022-03-15T05:50:02.279866+0000","last_unstale":"2022-03-15T05:50:02.285627+0000","last_undegraded":"2022-03-15T05:50:02.285627+0000","last_fullsized":"2022-03-15T05:50:02.285627+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:18:11.481888+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281731+0000","last_change":"2022-03-15T05:50:02.274634+0000","last_active":"2022-03-15T05:50:02.281731+0000","last_peered":"2022-03-15T05:50:02.281731+0000","last_clean":"2022-03-15T05:50:02.281731+0000","last_became_active":"2022-03-15T05:50:02.274365+0000","last_became_peered":"2022-03-15T05:50:02.274365+0000","last_unstale":"2022-03-15T05:50:02.281731+0000","last_undegraded":"2022-03-15T05:50:02.281731+0000","last_fullsized":"2022-03-15T05:50:02.281731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:30:21.663420+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286792+0000","last_change":"2022-03-15T05:50:02.285013+0000","last_active":"2022-03-15T05:50:02.286792+0000","last_peered":"2022-03-15T05:50:02.286792+0000","last_clean":"2022-03-15T05:50:02.286792+0000","last_became_active":"2022-03-15T05:50:02.284464+0000","last_became_peered":"2022-03-15T05:50:02.284464+0000","last_unstale":"2022-03-15T05:50:02.286792+0000","last_undegraded":"2022-03-15T05:50:02.286792+0000","last_fullsized":"2022-03-15T05:50:02.286792+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:46:35.006614+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273371+0000","last_change":"2022-03-15T05:50:02.270735+0000","last_active":"2022-03-15T05:50:02.273371+0000","last_peered":"2022-03-15T05:50:02.273371+0000","last_clean":"2022-03-15T05:50:02.273371+0000","last_became_active":"2022-03-15T05:50:02.270318+0000","last_became_peered":"2022-03-15T05:50:02.270318+0000","last_unstale":"2022-03-15T05:50:02.273371+0000","last_undegraded":"2022-03-15T05:50:02.273371+0000","last_fullsized":"2022-03-15T05:50:02.273371+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:12:33.142086+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278502+0000","last_change":"2022-03-15T05:50:02.273007+0000","last_active":"2022-03-15T05:50:02.278502+0000","last_peered":"2022-03-15T05:50:02.278502+0000","last_clean":"2022-03-15T05:50:02.278502+0000","last_became_active":"2022-03-15T05:50:02.272523+0000","last_became_peered":"2022-03-15T05:50:02.272523+0000","last_unstale":"2022-03-15T05:50:02.278502+0000","last_undegraded":"2022-03-15T05:50:02.278502+0000","last_fullsized":"2022-03-15T05:50:02.278502+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:21:35.681401+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286135+0000","last_change":"2022-03-15T05:50:02.278777+0000","last_active":"2022-03-15T05:50:02.286135+0000","last_peered":"2022-03-15T05:50:02.286135+0000","last_clean":"2022-03-15T05:50:02.286135+0000","last_became_active":"2022-03-15T05:50:02.278500+0000","last_became_peered":"2022-03-15T05:50:02.278500+0000","last_unstale":"2022-03-15T05:50:02.286135+0000","last_undegraded":"2022-03-15T05:50:02.286135+0000","last_fullsized":"2022-03-15T05:50:02.286135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:38:10.301072+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284707+0000","last_change":"2022-03-15T05:50:02.283008+0000","last_active":"2022-03-15T05:50:02.284707+0000","last_peered":"2022-03-15T05:50:02.284707+0000","last_clean":"2022-03-15T05:50:02.284707+0000","last_became_active":"2022-03-15T05:50:02.282701+0000","last_became_peered":"2022-03-15T05:50:02.282701+0000","last_unstale":"2022-03-15T05:50:02.284707+0000","last_undegraded":"2022-03-15T05:50:02.284707+0000","last_fullsized":"2022-03-15T05:50:02.284707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:27:00.079571+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277381+0000","last_change":"2022-03-15T05:50:02.274545+0000","last_active":"2022-03-15T05:50:02.277381+0000","last_peered":"2022-03-15T05:50:02.277381+0000","last_clean":"2022-03-15T05:50:02.277381+0000","last_became_active":"2022-03-15T05:50:02.274210+0000","last_became_peered":"2022-03-15T05:50:02.274210+0000","last_unstale":"2022-03-15T05:50:02.277381+0000","last_undegraded":"2022-03-15T05:50:02.277381+0000","last_fullsized":"2022-03-15T05:50:02.277381+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:56:38.005714+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282124+0000","last_change":"2022-03-15T05:50:02.276880+0000","last_active":"2022-03-15T05:50:02.282124+0000","last_peered":"2022-03-15T05:50:02.282124+0000","last_clean":"2022-03-15T05:50:02.282124+0000","last_became_active":"2022-03-15T05:50:02.276611+0000","last_became_peered":"2022-03-15T05:50:02.276611+0000","last_unstale":"2022-03-15T05:50:02.282124+0000","last_undegraded":"2022-03-15T05:50:02.282124+0000","last_fullsized":"2022-03-15T05:50:02.282124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:00:13.209564+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278683+0000","last_change":"2022-03-15T05:50:02.276997+0000","last_active":"2022-03-15T05:50:02.278683+0000","last_peered":"2022-03-15T05:50:02.278683+0000","last_clean":"2022-03-15T05:50:02.278683+0000","last_became_active":"2022-03-15T05:50:02.276696+0000","last_became_peered":"2022-03-15T05:50:02.276696+0000","last_unstale":"2022-03-15T05:50:02.278683+0000","last_undegraded":"2022-03-15T05:50:02.278683+0000","last_fullsized":"2022-03-15T05:50:02.278683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:00:32.831962+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281465+0000","last_change":"2022-03-15T05:50:02.269800+0000","last_active":"2022-03-15T05:50:02.281465+0000","last_peered":"2022-03-15T05:50:02.281465+0000","last_clean":"2022-03-15T05:50:02.281465+0000","last_became_active":"2022-03-15T05:50:02.269477+0000","last_became_peered":"2022-03-15T05:50:02.269477+0000","last_unstale":"2022-03-15T05:50:02.281465+0000","last_undegraded":"2022-03-15T05:50:02.281465+0000","last_fullsized":"2022-03-15T05:50:02.281465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:24:26.061545+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275881+0000","last_change":"2022-03-15T05:50:02.269504+0000","last_active":"2022-03-15T05:50:02.275881+0000","last_peered":"2022-03-15T05:50:02.275881+0000","last_clean":"2022-03-15T05:50:02.275881+0000","last_became_active":"2022-03-15T05:50:02.269199+0000","last_became_peered":"2022-03-15T05:50:02.269199+0000","last_unstale":"2022-03-15T05:50:02.275881+0000","last_undegraded":"2022-03-15T05:50:02.275881+0000","last_fullsized":"2022-03-15T05:50:02.275881+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:48:27.314870+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280537+0000","last_change":"2022-03-15T05:50:02.271878+0000","last_active":"2022-03-15T05:50:02.280537+0000","last_peered":"2022-03-15T05:50:02.280537+0000","last_clean":"2022-03-15T05:50:02.280537+0000","last_became_active":"2022-03-15T05:50:02.271545+0000","last_became_peered":"2022-03-15T05:50:02.271545+0000","last_unstale":"2022-03-15T05:50:02.280537+0000","last_undegraded":"2022-03-15T05:50:02.280537+0000","last_fullsized":"2022-03-15T05:50:02.280537+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:29:55.714092+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284711+0000","last_change":"2022-03-15T05:50:02.283062+0000","last_active":"2022-03-15T05:50:02.284711+0000","last_peered":"2022-03-15T05:50:02.284711+0000","last_clean":"2022-03-15T05:50:02.284711+0000","last_became_active":"2022-03-15T05:50:02.282688+0000","last_became_peered":"2022-03-15T05:50:02.282688+0000","last_unstale":"2022-03-15T05:50:02.284711+0000","last_undegraded":"2022-03-15T05:50:02.284711+0000","last_fullsized":"2022-03-15T05:50:02.284711+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:28:47.117343+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.276419+0000","last_change":"2022-03-15T05:50:02.267259+0000","last_active":"2022-03-15T05:50:02.276419+0000","last_peered":"2022-03-15T05:50:02.276419+0000","last_clean":"2022-03-15T05:50:02.276419+0000","last_became_active":"2022-03-15T05:50:02.266987+0000","last_became_peered":"2022-03-15T05:50:02.266987+0000","last_unstale":"2022-03-15T05:50:02.276419+0000","last_undegraded":"2022-03-15T05:50:02.276419+0000","last_fullsized":"2022-03-15T05:50:02.276419+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:58:11.812955+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280321+0000","last_change":"2022-03-15T05:50:02.276941+0000","last_active":"2022-03-15T05:50:02.280321+0000","last_peered":"2022-03-15T05:50:02.280321+0000","last_clean":"2022-03-15T05:50:02.280321+0000","last_became_active":"2022-03-15T05:50:02.276681+0000","last_became_peered":"2022-03-15T05:50:02.276681+0000","last_unstale":"2022-03-15T05:50:02.280321+0000","last_undegraded":"2022-03-15T05:50:02.280321+0000","last_fullsized":"2022-03-15T05:50:02.280321+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:33:21.840005+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.269747+0000","last_change":"2022-03-15T05:50:02.269105+0000","last_active":"2022-03-15T05:50:02.269747+0000","last_peered":"2022-03-15T05:50:02.269747+0000","last_clean":"2022-03-15T05:50:02.269747+0000","last_became_active":"2022-03-15T05:50:02.268808+0000","last_became_peered":"2022-03-15T05:50:02.268808+0000","last_unstale":"2022-03-15T05:50:02.269747+0000","last_undegraded":"2022-03-15T05:50:02.269747+0000","last_fullsized":"2022-03-15T05:50:02.269747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:52:28.049853+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280638+0000","last_change":"2022-03-15T05:50:02.277497+0000","last_active":"2022-03-15T05:50:02.280638+0000","last_peered":"2022-03-15T05:50:02.280638+0000","last_clean":"2022-03-15T05:50:02.280638+0000","last_became_active":"2022-03-15T05:50:02.277184+0000","last_became_peered":"2022-03-15T05:50:02.277184+0000","last_unstale":"2022-03-15T05:50:02.280638+0000","last_undegraded":"2022-03-15T05:50:02.280638+0000","last_fullsized":"2022-03-15T05:50:02.280638+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:35:31.460982+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280352+0000","last_change":"2022-03-15T05:50:02.277944+0000","last_active":"2022-03-15T05:50:02.280352+0000","last_peered":"2022-03-15T05:50:02.280352+0000","last_clean":"2022-03-15T05:50:02.280352+0000","last_became_active":"2022-03-15T05:50:02.277565+0000","last_became_peered":"2022-03-15T05:50:02.277565+0000","last_unstale":"2022-03-15T05:50:02.280352+0000","last_undegraded":"2022-03-15T05:50:02.280352+0000","last_fullsized":"2022-03-15T05:50:02.280352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:05:09.174014+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278568+0000","last_change":"2022-03-15T05:50:02.273042+0000","last_active":"2022-03-15T05:50:02.278568+0000","last_peered":"2022-03-15T05:50:02.278568+0000","last_clean":"2022-03-15T05:50:02.278568+0000","last_became_active":"2022-03-15T05:50:02.272528+0000","last_became_peered":"2022-03-15T05:50:02.272528+0000","last_unstale":"2022-03-15T05:50:02.278568+0000","last_undegraded":"2022-03-15T05:50:02.278568+0000","last_fullsized":"2022-03-15T05:50:02.278568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:38:32.868531+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278082+0000","last_change":"2022-03-15T05:50:02.270444+0000","last_active":"2022-03-15T05:50:02.278082+0000","last_peered":"2022-03-15T05:50:02.278082+0000","last_clean":"2022-03-15T05:50:02.278082+0000","last_became_active":"2022-03-15T05:50:02.270129+0000","last_became_peered":"2022-03-15T05:50:02.270129+0000","last_unstale":"2022-03-15T05:50:02.278082+0000","last_undegraded":"2022-03-15T05:50:02.278082+0000","last_fullsized":"2022-03-15T05:50:02.278082+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:18:58.888559+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285050+0000","last_change":"2022-03-15T05:50:02.279990+0000","last_active":"2022-03-15T05:50:02.285050+0000","last_peered":"2022-03-15T05:50:02.285050+0000","last_clean":"2022-03-15T05:50:02.285050+0000","last_became_active":"2022-03-15T05:50:02.279527+0000","last_became_peered":"2022-03-15T05:50:02.279527+0000","last_unstale":"2022-03-15T05:50:02.285050+0000","last_undegraded":"2022-03-15T05:50:02.285050+0000","last_fullsized":"2022-03-15T05:50:02.285050+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:10:41.298991+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:04.413706+0000","last_change":"2022-03-15T05:50:01.757857+0000","last_active":"2022-03-15T05:50:04.413706+0000","last_peered":"2022-03-15T05:50:04.413706+0000","last_clean":"2022-03-15T05:50:04.413706+0000","last_became_active":"2022-03-15T05:50:01.757378+0000","last_became_peered":"2022-03-15T05:50:01.757378+0000","last_unstale":"2022-03-15T05:50:04.413706+0000","last_undegraded":"2022-03-15T05:50:04.413706+0000","last_fullsized":"2022-03-15T05:50:04.413706+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:29:24.796802+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278203+0000","last_change":"2022-03-15T05:50:02.274309+0000","last_active":"2022-03-15T05:50:02.278203+0000","last_peered":"2022-03-15T05:50:02.278203+0000","last_clean":"2022-03-15T05:50:02.278203+0000","last_became_active":"2022-03-15T05:50:02.273944+0000","last_became_peered":"2022-03-15T05:50:02.273944+0000","last_unstale":"2022-03-15T05:50:02.278203+0000","last_undegraded":"2022-03-15T05:50:02.278203+0000","last_fullsized":"2022-03-15T05:50:02.278203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:31:34.056283+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263479+0000","last_change":"2022-03-15T05:50:01.761316+0000","last_active":"2022-03-15T05:50:02.263479+0000","last_peered":"2022-03-15T05:50:02.263479+0000","last_clean":"2022-03-15T05:50:02.263479+0000","last_became_active":"2022-03-15T05:50:01.761064+0000","last_became_peered":"2022-03-15T05:50:01.761064+0000","last_unstale":"2022-03-15T05:50:02.263479+0000","last_undegraded":"2022-03-15T05:50:02.263479+0000","last_fullsized":"2022-03-15T05:50:02.263479+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:08:39.825646+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280915+0000","last_change":"2022-03-15T05:50:02.278164+0000","last_active":"2022-03-15T05:50:02.280915+0000","last_peered":"2022-03-15T05:50:02.280915+0000","last_clean":"2022-03-15T05:50:02.280915+0000","last_became_active":"2022-03-15T05:50:02.277785+0000","last_became_peered":"2022-03-15T05:50:02.277785+0000","last_unstale":"2022-03-15T05:50:02.280915+0000","last_undegraded":"2022-03-15T05:50:02.280915+0000","last_fullsized":"2022-03-15T05:50:02.280915+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:55:34.060331+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266525+0000","last_change":"2022-03-15T05:50:01.756648+0000","last_active":"2022-03-15T05:50:02.266525+0000","last_peered":"2022-03-15T05:50:02.266525+0000","last_clean":"2022-03-15T05:50:02.266525+0000","last_became_active":"2022-03-15T05:50:01.755611+0000","last_became_peered":"2022-03-15T05:50:01.755611+0000","last_unstale":"2022-03-15T05:50:02.266525+0000","last_undegraded":"2022-03-15T05:50:02.266525+0000","last_fullsized":"2022-03-15T05:50:02.266525+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:34:52.558274+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281413+0000","last_change":"2022-03-15T05:50:02.273665+0000","last_active":"2022-03-15T05:50:02.281413+0000","last_peered":"2022-03-15T05:50:02.281413+0000","last_clean":"2022-03-15T05:50:02.281413+0000","last_became_active":"2022-03-15T05:50:02.273305+0000","last_became_peered":"2022-03-15T05:50:02.273305+0000","last_unstale":"2022-03-15T05:50:02.281413+0000","last_undegraded":"2022-03-15T05:50:02.281413+0000","last_fullsized":"2022-03-15T05:50:02.281413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:09:21.723908+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.268432+0000","last_change":"2022-03-15T05:50:01.766117+0000","last_active":"2022-03-15T05:50:02.268432+0000","last_peered":"2022-03-15T05:50:02.268432+0000","last_clean":"2022-03-15T05:50:02.268432+0000","last_became_active":"2022-03-15T05:50:01.765787+0000","last_became_peered":"2022-03-15T05:50:01.765787+0000","last_unstale":"2022-03-15T05:50:02.268432+0000","last_undegraded":"2022-03-15T05:50:02.268432+0000","last_fullsized":"2022-03-15T05:50:02.268432+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:01:30.570219+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282069+0000","last_change":"2022-03-15T05:50:02.281022+0000","last_active":"2022-03-15T05:50:02.282069+0000","last_peered":"2022-03-15T05:50:02.282069+0000","last_clean":"2022-03-15T05:50:02.282069+0000","last_became_active":"2022-03-15T05:50:02.280637+0000","last_became_peered":"2022-03-15T05:50:02.280637+0000","last_unstale":"2022-03-15T05:50:02.282069+0000","last_undegraded":"2022-03-15T05:50:02.282069+0000","last_fullsized":"2022-03-15T05:50:02.282069+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:22:20.683447+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:12.665379+0000","last_change":"2022-03-15T05:50:01.761879+0000","last_active":"2022-03-15T05:50:12.665379+0000","last_peered":"2022-03-15T05:50:12.665379+0000","last_clean":"2022-03-15T05:50:12.665379+0000","last_became_active":"2022-03-15T05:50:01.761612+0000","last_became_peered":"2022-03-15T05:50:01.761612+0000","last_unstale":"2022-03-15T05:50:12.665379+0000","last_undegraded":"2022-03-15T05:50:12.665379+0000","last_fullsized":"2022-03-15T05:50:12.665379+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:48:49.655032+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.282022+0000","last_change":"2022-03-15T05:50:02.280735+0000","last_active":"2022-03-15T05:50:02.282022+0000","last_peered":"2022-03-15T05:50:02.282022+0000","last_clean":"2022-03-15T05:50:02.282022+0000","last_became_active":"2022-03-15T05:50:02.280417+0000","last_became_peered":"2022-03-15T05:50:02.280417+0000","last_unstale":"2022-03-15T05:50:02.282022+0000","last_undegraded":"2022-03-15T05:50:02.282022+0000","last_fullsized":"2022-03-15T05:50:02.282022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:02:09.355535+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"24'3","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.264391+0000","last_change":"2022-03-15T05:50:01.763468+0000","last_active":"2022-03-15T05:50:07.264391+0000","last_peered":"2022-03-15T05:50:07.264391+0000","last_clean":"2022-03-15T05:50:07.264391+0000","last_became_active":"2022-03-15T05:50:01.763046+0000","last_became_peered":"2022-03-15T05:50:01.763046+0000","last_unstale":"2022-03-15T05:50:07.264391+0000","last_undegraded":"2022-03-15T05:50:07.264391+0000","last_fullsized":"2022-03-15T05:50:07.264391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:02:04.856436+0000","stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.276334+0000","last_change":"2022-03-15T05:50:02.272492+0000","last_active":"2022-03-15T05:50:02.276334+0000","last_peered":"2022-03-15T05:50:02.276334+0000","last_clean":"2022-03-15T05:50:02.276334+0000","last_became_active":"2022-03-15T05:50:02.266942+0000","last_became_peered":"2022-03-15T05:50:02.266942+0000","last_unstale":"2022-03-15T05:50:02.276334+0000","last_undegraded":"2022-03-15T05:50:02.276334+0000","last_fullsized":"2022-03-15T05:50:02.276334+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:48:30.216948+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"24'8","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:12.666559+0000","last_change":"2022-03-15T05:50:01.767583+0000","last_active":"2022-03-15T05:50:12.666559+0000","last_peered":"2022-03-15T05:50:12.666559+0000","last_clean":"2022-03-15T05:50:12.666559+0000","last_became_active":"2022-03-15T05:50:01.766773+0000","last_became_peered":"2022-03-15T05:50:01.766773+0000","last_unstale":"2022-03-15T05:50:12.666559+0000","last_undegraded":"2022-03-15T05:50:12.666559+0000","last_fullsized":"2022-03-15T05:50:12.666559+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:23:44.248528+0000","stat_sum":{"num_bytes":1548,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278156+0000","last_change":"2022-03-15T05:50:02.271456+0000","last_active":"2022-03-15T05:50:02.278156+0000","last_peered":"2022-03-15T05:50:02.278156+0000","last_clean":"2022-03-15T05:50:02.278156+0000","last_became_active":"2022-03-15T05:50:02.270402+0000","last_became_peered":"2022-03-15T05:50:02.270402+0000","last_unstale":"2022-03-15T05:50:02.278156+0000","last_undegraded":"2022-03-15T05:50:02.278156+0000","last_fullsized":"2022-03-15T05:50:02.278156+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:29:17.756689+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"24'4","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:12.666209+0000","last_change":"2022-03-15T05:50:01.768867+0000","last_active":"2022-03-15T05:50:12.666209+0000","last_peered":"2022-03-15T05:50:12.666209+0000","last_clean":"2022-03-15T05:50:12.666209+0000","last_became_active":"2022-03-15T05:50:01.768586+0000","last_became_peered":"2022-03-15T05:50:01.768586+0000","last_unstale":"2022-03-15T05:50:12.666209+0000","last_undegraded":"2022-03-15T05:50:12.666209+0000","last_fullsized":"2022-03-15T05:50:12.666209+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:54:20.464304+0000","stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279217+0000","last_change":"2022-03-15T05:50:02.277330+0000","last_active":"2022-03-15T05:50:02.279217+0000","last_peered":"2022-03-15T05:50:02.279217+0000","last_clean":"2022-03-15T05:50:02.279217+0000","last_became_active":"2022-03-15T05:50:02.276873+0000","last_became_peered":"2022-03-15T05:50:02.276873+0000","last_unstale":"2022-03-15T05:50:02.279217+0000","last_undegraded":"2022-03-15T05:50:02.279217+0000","last_fullsized":"2022-03-15T05:50:02.279217+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:24:11.044313+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266707+0000","last_change":"2022-03-15T05:50:01.768784+0000","last_active":"2022-03-15T05:50:02.266707+0000","last_peered":"2022-03-15T05:50:02.266707+0000","last_clean":"2022-03-15T05:50:02.266707+0000","last_became_active":"2022-03-15T05:50:01.768446+0000","last_became_peered":"2022-03-15T05:50:01.768446+0000","last_unstale":"2022-03-15T05:50:02.266707+0000","last_undegraded":"2022-03-15T05:50:02.266707+0000","last_fullsized":"2022-03-15T05:50:02.266707+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:17:30.808770+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.285030+0000","last_change":"2022-03-15T05:50:02.279791+0000","last_active":"2022-03-15T05:50:02.285030+0000","last_peered":"2022-03-15T05:50:02.285030+0000","last_clean":"2022-03-15T05:50:02.285030+0000","last_became_active":"2022-03-15T05:50:02.279172+0000","last_became_peered":"2022-03-15T05:50:02.279172+0000","last_unstale":"2022-03-15T05:50:02.285030+0000","last_undegraded":"2022-03-15T05:50:02.285030+0000","last_fullsized":"2022-03-15T05:50:02.285030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:06:01.717047+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261139+0000","last_change":"2022-03-15T05:50:01.765934+0000","last_active":"2022-03-15T05:50:02.261139+0000","last_peered":"2022-03-15T05:50:02.261139+0000","last_clean":"2022-03-15T05:50:02.261139+0000","last_became_active":"2022-03-15T05:50:01.765593+0000","last_became_peered":"2022-03-15T05:50:01.765593+0000","last_unstale":"2022-03-15T05:50:02.261139+0000","last_undegraded":"2022-03-15T05:50:02.261139+0000","last_fullsized":"2022-03-15T05:50:02.261139+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:17:58.343945+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273584+0000","last_change":"2022-03-15T05:50:02.271214+0000","last_active":"2022-03-15T05:50:02.273584+0000","last_peered":"2022-03-15T05:50:02.273584+0000","last_clean":"2022-03-15T05:50:02.273584+0000","last_became_active":"2022-03-15T05:50:02.270503+0000","last_became_peered":"2022-03-15T05:50:02.270503+0000","last_unstale":"2022-03-15T05:50:02.273584+0000","last_undegraded":"2022-03-15T05:50:02.273584+0000","last_fullsized":"2022-03-15T05:50:02.273584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:46:34.707474+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"24'8","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.266616+0000","last_change":"2022-03-15T05:50:01.760128+0000","last_active":"2022-03-15T05:50:07.266616+0000","last_peered":"2022-03-15T05:50:07.266616+0000","last_clean":"2022-03-15T05:50:07.266616+0000","last_became_active":"2022-03-15T05:50:01.759822+0000","last_became_peered":"2022-03-15T05:50:01.759822+0000","last_unstale":"2022-03-15T05:50:07.266616+0000","last_undegraded":"2022-03-15T05:50:07.266616+0000","last_fullsized":"2022-03-15T05:50:07.266616+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:18:48.265357+0000","stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280983+0000","last_change":"2022-03-15T05:50:02.279712+0000","last_active":"2022-03-15T05:50:02.280983+0000","last_peered":"2022-03-15T05:50:02.280983+0000","last_clean":"2022-03-15T05:50:02.280983+0000","last_became_active":"2022-03-15T05:50:02.279212+0000","last_became_peered":"2022-03-15T05:50:02.279212+0000","last_unstale":"2022-03-15T05:50:02.280983+0000","last_undegraded":"2022-03-15T05:50:02.280983+0000","last_fullsized":"2022-03-15T05:50:02.280983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:19:44.101895+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:03.931263+0000","last_change":"2022-03-15T05:50:01.758101+0000","last_active":"2022-03-15T05:50:03.931263+0000","last_peered":"2022-03-15T05:50:03.931263+0000","last_clean":"2022-03-15T05:50:03.931263+0000","last_became_active":"2022-03-15T05:50:01.757825+0000","last_became_peered":"2022-03-15T05:50:01.757825+0000","last_unstale":"2022-03-15T05:50:03.931263+0000","last_undegraded":"2022-03-15T05:50:03.931263+0000","last_fullsized":"2022-03-15T05:50:03.931263+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:17:42.303241+0000","stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.281448+0000","last_change":"2022-03-15T05:50:02.267337+0000","last_active":"2022-03-15T05:50:02.281448+0000","last_peered":"2022-03-15T05:50:02.281448+0000","last_clean":"2022-03-15T05:50:02.281448+0000","last_became_active":"2022-03-15T05:50:02.267082+0000","last_became_peered":"2022-03-15T05:50:02.267082+0000","last_unstale":"2022-03-15T05:50:02.281448+0000","last_undegraded":"2022-03-15T05:50:02.281448+0000","last_fullsized":"2022-03-15T05:50:02.281448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:28:10.148060+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.265537+0000","last_change":"2022-03-15T05:50:01.766324+0000","last_active":"2022-03-15T05:50:07.265537+0000","last_peered":"2022-03-15T05:50:07.265537+0000","last_clean":"2022-03-15T05:50:07.265537+0000","last_became_active":"2022-03-15T05:50:01.766008+0000","last_became_peered":"2022-03-15T05:50:01.766008+0000","last_unstale":"2022-03-15T05:50:07.265537+0000","last_undegraded":"2022-03-15T05:50:07.265537+0000","last_fullsized":"2022-03-15T05:50:07.265537+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:00:37.206705+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280289+0000","last_change":"2022-03-15T05:50:02.276334+0000","last_active":"2022-03-15T05:50:02.280289+0000","last_peered":"2022-03-15T05:50:02.280289+0000","last_clean":"2022-03-15T05:50:02.280289+0000","last_became_active":"2022-03-15T05:50:02.276030+0000","last_became_peered":"2022-03-15T05:50:02.276030+0000","last_unstale":"2022-03-15T05:50:02.280289+0000","last_undegraded":"2022-03-15T05:50:02.280289+0000","last_fullsized":"2022-03-15T05:50:02.280289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:24:56.245923+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:03.259992+0000","last_change":"2022-03-15T05:50:01.771270+0000","last_active":"2022-03-15T05:50:03.259992+0000","last_peered":"2022-03-15T05:50:03.259992+0000","last_clean":"2022-03-15T05:50:03.259992+0000","last_became_active":"2022-03-15T05:50:01.770985+0000","last_became_peered":"2022-03-15T05:50:01.770985+0000","last_unstale":"2022-03-15T05:50:03.259992+0000","last_undegraded":"2022-03-15T05:50:03.259992+0000","last_fullsized":"2022-03-15T05:50:03.259992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:28:26.138901+0000","stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277231+0000","last_change":"2022-03-15T05:50:02.270661+0000","last_active":"2022-03-15T05:50:02.277231+0000","last_peered":"2022-03-15T05:50:02.277231+0000","last_clean":"2022-03-15T05:50:02.277231+0000","last_became_active":"2022-03-15T05:50:02.270338+0000","last_became_peered":"2022-03-15T05:50:02.270338+0000","last_unstale":"2022-03-15T05:50:02.277231+0000","last_undegraded":"2022-03-15T05:50:02.277231+0000","last_fullsized":"2022-03-15T05:50:02.277231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:07:13.970018+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261651+0000","last_change":"2022-03-15T05:50:01.760891+0000","last_active":"2022-03-15T05:50:02.261651+0000","last_peered":"2022-03-15T05:50:02.261651+0000","last_clean":"2022-03-15T05:50:02.261651+0000","last_became_active":"2022-03-15T05:50:01.760552+0000","last_became_peered":"2022-03-15T05:50:01.760552+0000","last_unstale":"2022-03-15T05:50:02.261651+0000","last_undegraded":"2022-03-15T05:50:02.261651+0000","last_fullsized":"2022-03-15T05:50:02.261651+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:10:36.649419+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278969+0000","last_change":"2022-03-15T05:50:02.277381+0000","last_active":"2022-03-15T05:50:02.278969+0000","last_peered":"2022-03-15T05:50:02.278969+0000","last_clean":"2022-03-15T05:50:02.278969+0000","last_became_active":"2022-03-15T05:50:02.277113+0000","last_became_peered":"2022-03-15T05:50:02.277113+0000","last_unstale":"2022-03-15T05:50:02.278969+0000","last_undegraded":"2022-03-15T05:50:02.278969+0000","last_fullsized":"2022-03-15T05:50:02.278969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:20:07.922465+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.b","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.263277+0000","last_change":"2022-03-15T05:50:01.757991+0000","last_active":"2022-03-15T05:50:07.263277+0000","last_peered":"2022-03-15T05:50:07.263277+0000","last_clean":"2022-03-15T05:50:07.263277+0000","last_became_active":"2022-03-15T05:50:01.757651+0000","last_became_peered":"2022-03-15T05:50:01.757651+0000","last_unstale":"2022-03-15T05:50:07.263277+0000","last_undegraded":"2022-03-15T05:50:07.263277+0000","last_fullsized":"2022-03-15T05:50:07.263277+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:17:51.775038+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278650+0000","last_change":"2022-03-15T05:50:02.277017+0000","last_active":"2022-03-15T05:50:02.278650+0000","last_peered":"2022-03-15T05:50:02.278650+0000","last_clean":"2022-03-15T05:50:02.278650+0000","last_became_active":"2022-03-15T05:50:02.276718+0000","last_became_peered":"2022-03-15T05:50:02.276718+0000","last_unstale":"2022-03-15T05:50:02.278650+0000","last_undegraded":"2022-03-15T05:50:02.278650+0000","last_fullsized":"2022-03-15T05:50:02.278650+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:56:31.659289+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261713+0000","last_change":"2022-03-15T05:50:01.764679+0000","last_active":"2022-03-15T05:50:02.261713+0000","last_peered":"2022-03-15T05:50:02.261713+0000","last_clean":"2022-03-15T05:50:02.261713+0000","last_became_active":"2022-03-15T05:50:01.761848+0000","last_became_peered":"2022-03-15T05:50:01.761848+0000","last_unstale":"2022-03-15T05:50:02.261713+0000","last_undegraded":"2022-03-15T05:50:02.261713+0000","last_fullsized":"2022-03-15T05:50:02.261713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:14:14.162973+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286066+0000","last_change":"2022-03-15T05:50:02.283961+0000","last_active":"2022-03-15T05:50:02.286066+0000","last_peered":"2022-03-15T05:50:02.286066+0000","last_clean":"2022-03-15T05:50:02.286066+0000","last_became_active":"2022-03-15T05:50:02.283237+0000","last_became_peered":"2022-03-15T05:50:02.283237+0000","last_unstale":"2022-03-15T05:50:02.286066+0000","last_undegraded":"2022-03-15T05:50:02.286066+0000","last_fullsized":"2022-03-15T05:50:02.286066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:42:49.764129+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"24'3","reported_seq":13,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:12.667319+0000","last_change":"2022-03-15T05:50:01.767200+0000","last_active":"2022-03-15T05:50:12.667319+0000","last_peered":"2022-03-15T05:50:12.667319+0000","last_clean":"2022-03-15T05:50:12.667319+0000","last_became_active":"2022-03-15T05:50:01.766581+0000","last_became_peered":"2022-03-15T05:50:01.766581+0000","last_unstale":"2022-03-15T05:50:12.667319+0000","last_undegraded":"2022-03-15T05:50:12.667319+0000","last_fullsized":"2022-03-15T05:50:12.667319+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:58:11.088344+0000","stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275948+0000","last_change":"2022-03-15T05:50:02.270649+0000","last_active":"2022-03-15T05:50:02.275948+0000","last_peered":"2022-03-15T05:50:02.275948+0000","last_clean":"2022-03-15T05:50:02.275948+0000","last_became_active":"2022-03-15T05:50:02.270308+0000","last_became_peered":"2022-03-15T05:50:02.270308+0000","last_unstale":"2022-03-15T05:50:02.275948+0000","last_undegraded":"2022-03-15T05:50:02.275948+0000","last_fullsized":"2022-03-15T05:50:02.275948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:18:01.692755+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263279+0000","last_change":"2022-03-15T05:50:01.758464+0000","last_active":"2022-03-15T05:50:02.263279+0000","last_peered":"2022-03-15T05:50:02.263279+0000","last_clean":"2022-03-15T05:50:02.263279+0000","last_became_active":"2022-03-15T05:50:01.757936+0000","last_became_peered":"2022-03-15T05:50:01.757936+0000","last_unstale":"2022-03-15T05:50:02.263279+0000","last_undegraded":"2022-03-15T05:50:02.263279+0000","last_fullsized":"2022-03-15T05:50:02.263279+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:44:19.373542+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.278115+0000","last_change":"2022-03-15T05:50:02.270500+0000","last_active":"2022-03-15T05:50:02.278115+0000","last_peered":"2022-03-15T05:50:02.278115+0000","last_clean":"2022-03-15T05:50:02.278115+0000","last_became_active":"2022-03-15T05:50:02.270165+0000","last_became_peered":"2022-03-15T05:50:02.270165+0000","last_unstale":"2022-03-15T05:50:02.278115+0000","last_undegraded":"2022-03-15T05:50:02.278115+0000","last_fullsized":"2022-03-15T05:50:02.278115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:20:11.113002+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.267755+0000","last_change":"2022-03-15T05:49:56.006265+0000","last_active":"2022-03-15T05:50:02.267755+0000","last_peered":"2022-03-15T05:50:02.267755+0000","last_clean":"2022-03-15T05:50:02.267755+0000","last_became_active":"2022-03-15T05:49:56.005945+0000","last_became_peered":"2022-03-15T05:49:56.005945+0000","last_unstale":"2022-03-15T05:50:02.267755+0000","last_undegraded":"2022-03-15T05:50:02.267755+0000","last_fullsized":"2022-03-15T05:50:02.267755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T05:59:10.545960+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.5","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:03.259409+0000","last_change":"2022-03-15T05:50:01.756552+0000","last_active":"2022-03-15T05:50:03.259409+0000","last_peered":"2022-03-15T05:50:03.259409+0000","last_clean":"2022-03-15T05:50:03.259409+0000","last_became_active":"2022-03-15T05:50:01.755731+0000","last_became_peered":"2022-03-15T05:50:01.755731+0000","last_unstale":"2022-03-15T05:50:03.259409+0000","last_undegraded":"2022-03-15T05:50:03.259409+0000","last_fullsized":"2022-03-15T05:50:03.259409+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:20:06.863246+0000","stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277227+0000","last_change":"2022-03-15T05:50:02.271788+0000","last_active":"2022-03-15T05:50:02.277227+0000","last_peered":"2022-03-15T05:50:02.277227+0000","last_clean":"2022-03-15T05:50:02.277227+0000","last_became_active":"2022-03-15T05:50:02.271479+0000","last_became_peered":"2022-03-15T05:50:02.271479+0000","last_unstale":"2022-03-15T05:50:02.277227+0000","last_undegraded":"2022-03-15T05:50:02.277227+0000","last_fullsized":"2022-03-15T05:50:02.277227+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:50:05.553818+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261866+0000","last_change":"2022-03-15T05:49:56.006179+0000","last_active":"2022-03-15T05:50:02.261866+0000","last_peered":"2022-03-15T05:50:02.261866+0000","last_clean":"2022-03-15T05:50:02.261866+0000","last_became_active":"2022-03-15T05:49:56.005909+0000","last_became_peered":"2022-03-15T05:49:56.005909+0000","last_unstale":"2022-03-15T05:50:02.261866+0000","last_undegraded":"2022-03-15T05:50:02.261866+0000","last_fullsized":"2022-03-15T05:50:02.261866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:24:44.215515+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.262943+0000","last_change":"2022-03-15T05:50:01.764346+0000","last_active":"2022-03-15T05:50:02.262943+0000","last_peered":"2022-03-15T05:50:02.262943+0000","last_clean":"2022-03-15T05:50:02.262943+0000","last_became_active":"2022-03-15T05:50:01.763997+0000","last_became_peered":"2022-03-15T05:50:01.763997+0000","last_unstale":"2022-03-15T05:50:02.262943+0000","last_undegraded":"2022-03-15T05:50:02.262943+0000","last_fullsized":"2022-03-15T05:50:02.262943+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:50:52.655627+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279198+0000","last_change":"2022-03-15T05:50:02.276942+0000","last_active":"2022-03-15T05:50:02.279198+0000","last_peered":"2022-03-15T05:50:02.279198+0000","last_clean":"2022-03-15T05:50:02.279198+0000","last_became_active":"2022-03-15T05:50:02.276353+0000","last_became_peered":"2022-03-15T05:50:02.276353+0000","last_unstale":"2022-03-15T05:50:02.279198+0000","last_undegraded":"2022-03-15T05:50:02.279198+0000","last_fullsized":"2022-03-15T05:50:02.279198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:30:47.020786+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.259035+0000","last_change":"2022-03-15T05:49:55.717507+0000","last_active":"2022-03-15T05:50:02.259035+0000","last_peered":"2022-03-15T05:50:02.259035+0000","last_clean":"2022-03-15T05:50:02.259035+0000","last_became_active":"2022-03-15T05:49:55.717125+0000","last_became_peered":"2022-03-15T05:49:55.717125+0000","last_unstale":"2022-03-15T05:50:02.259035+0000","last_undegraded":"2022-03-15T05:50:02.259035+0000","last_fullsized":"2022-03-15T05:50:02.259035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:01:26.511571+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266522+0000","last_change":"2022-03-15T05:50:01.756925+0000","last_active":"2022-03-15T05:50:02.266522+0000","last_peered":"2022-03-15T05:50:02.266522+0000","last_clean":"2022-03-15T05:50:02.266522+0000","last_became_active":"2022-03-15T05:50:01.756195+0000","last_became_peered":"2022-03-15T05:50:01.756195+0000","last_unstale":"2022-03-15T05:50:02.266522+0000","last_undegraded":"2022-03-15T05:50:02.266522+0000","last_fullsized":"2022-03-15T05:50:02.266522+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:37:07.377792+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277317+0000","last_change":"2022-03-15T05:50:02.272291+0000","last_active":"2022-03-15T05:50:02.277317+0000","last_peered":"2022-03-15T05:50:02.277317+0000","last_clean":"2022-03-15T05:50:02.277317+0000","last_became_active":"2022-03-15T05:50:02.271963+0000","last_became_peered":"2022-03-15T05:50:02.271963+0000","last_unstale":"2022-03-15T05:50:02.277317+0000","last_undegraded":"2022-03-15T05:50:02.277317+0000","last_fullsized":"2022-03-15T05:50:02.277317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:39:02.228387+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.264335+0000","last_change":"2022-03-15T05:49:55.714924+0000","last_active":"2022-03-15T05:50:02.264335+0000","last_peered":"2022-03-15T05:50:02.264335+0000","last_clean":"2022-03-15T05:50:02.264335+0000","last_became_active":"2022-03-15T05:49:55.714704+0000","last_became_peered":"2022-03-15T05:49:55.714704+0000","last_unstale":"2022-03-15T05:50:02.264335+0000","last_undegraded":"2022-03-15T05:50:02.264335+0000","last_fullsized":"2022-03-15T05:50:02.264335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:17:23.776392+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261862+0000","last_change":"2022-03-15T05:49:48.418992+0000","last_active":"2022-03-15T05:50:02.261862+0000","last_peered":"2022-03-15T05:50:02.261862+0000","last_clean":"2022-03-15T05:50:02.261862+0000","last_became_active":"2022-03-15T05:49:48.417864+0000","last_became_peered":"2022-03-15T05:49:48.417864+0000","last_unstale":"2022-03-15T05:50:02.261862+0000","last_undegraded":"2022-03-15T05:50:02.261862+0000","last_fullsized":"2022-03-15T05:50:02.261862+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:47.305366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:47.305366+0000","last_clean_scrub_stamp":"2022-03-15T05:49:47.305366+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:06:48.812663+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.265735+0000","last_change":"2022-03-15T05:50:01.768622+0000","last_active":"2022-03-15T05:50:02.265735+0000","last_peered":"2022-03-15T05:50:02.265735+0000","last_clean":"2022-03-15T05:50:02.265735+0000","last_became_active":"2022-03-15T05:50:01.768270+0000","last_became_peered":"2022-03-15T05:50:01.768270+0000","last_unstale":"2022-03-15T05:50:02.265735+0000","last_undegraded":"2022-03-15T05:50:02.265735+0000","last_fullsized":"2022-03-15T05:50:02.265735+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:53:03.610048+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.286021+0000","last_change":"2022-03-15T05:50:02.283485+0000","last_active":"2022-03-15T05:50:02.286021+0000","last_peered":"2022-03-15T05:50:02.286021+0000","last_clean":"2022-03-15T05:50:02.286021+0000","last_became_active":"2022-03-15T05:50:02.282868+0000","last_became_peered":"2022-03-15T05:50:02.282868+0000","last_unstale":"2022-03-15T05:50:02.286021+0000","last_undegraded":"2022-03-15T05:50:02.286021+0000","last_fullsized":"2022-03-15T05:50:02.286021+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:41:46.412779+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261606+0000","last_change":"2022-03-15T05:49:55.717054+0000","last_active":"2022-03-15T05:50:02.261606+0000","last_peered":"2022-03-15T05:50:02.261606+0000","last_clean":"2022-03-15T05:50:02.261606+0000","last_became_active":"2022-03-15T05:49:55.716665+0000","last_became_peered":"2022-03-15T05:49:55.716665+0000","last_unstale":"2022-03-15T05:50:02.261606+0000","last_undegraded":"2022-03-15T05:50:02.261606+0000","last_fullsized":"2022-03-15T05:50:02.261606+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:39:40.811968+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.263842+0000","last_change":"2022-03-15T05:50:01.759408+0000","last_active":"2022-03-15T05:50:02.263842+0000","last_peered":"2022-03-15T05:50:02.263842+0000","last_clean":"2022-03-15T05:50:02.263842+0000","last_became_active":"2022-03-15T05:50:01.759087+0000","last_became_peered":"2022-03-15T05:50:01.759087+0000","last_unstale":"2022-03-15T05:50:02.263842+0000","last_undegraded":"2022-03-15T05:50:02.263842+0000","last_fullsized":"2022-03-15T05:50:02.263842+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:16:33.815600+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.273561+0000","last_change":"2022-03-15T05:50:02.270677+0000","last_active":"2022-03-15T05:50:02.273561+0000","last_peered":"2022-03-15T05:50:02.273561+0000","last_clean":"2022-03-15T05:50:02.273561+0000","last_became_active":"2022-03-15T05:50:02.270124+0000","last_became_peered":"2022-03-15T05:50:02.270124+0000","last_unstale":"2022-03-15T05:50:02.273561+0000","last_undegraded":"2022-03-15T05:50:02.273561+0000","last_fullsized":"2022-03-15T05:50:02.273561+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:08:06.976250+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.264706+0000","last_change":"2022-03-15T05:49:55.717051+0000","last_active":"2022-03-15T05:50:02.264706+0000","last_peered":"2022-03-15T05:50:02.264706+0000","last_clean":"2022-03-15T05:50:02.264706+0000","last_became_active":"2022-03-15T05:49:55.716645+0000","last_became_peered":"2022-03-15T05:49:55.716645+0000","last_unstale":"2022-03-15T05:50:02.264706+0000","last_undegraded":"2022-03-15T05:50:02.264706+0000","last_fullsized":"2022-03-15T05:50:02.264706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:30:50.088264+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.265664+0000","last_change":"2022-03-15T05:50:01.751284+0000","last_active":"2022-03-15T05:50:02.265664+0000","last_peered":"2022-03-15T05:50:02.265664+0000","last_clean":"2022-03-15T05:50:02.265664+0000","last_became_active":"2022-03-15T05:50:01.750703+0000","last_became_peered":"2022-03-15T05:50:01.750703+0000","last_unstale":"2022-03-15T05:50:02.265664+0000","last_undegraded":"2022-03-15T05:50:02.265664+0000","last_fullsized":"2022-03-15T05:50:02.265664+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:38:23.932929+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277357+0000","last_change":"2022-03-15T05:50:02.272088+0000","last_active":"2022-03-15T05:50:02.277357+0000","last_peered":"2022-03-15T05:50:02.277357+0000","last_clean":"2022-03-15T05:50:02.277357+0000","last_became_active":"2022-03-15T05:50:02.271791+0000","last_became_peered":"2022-03-15T05:50:02.271791+0000","last_unstale":"2022-03-15T05:50:02.277357+0000","last_undegraded":"2022-03-15T05:50:02.277357+0000","last_fullsized":"2022-03-15T05:50:02.277357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:47:55.992221+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.7","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.260087+0000","last_change":"2022-03-15T05:50:01.760181+0000","last_active":"2022-03-15T05:50:07.260087+0000","last_peered":"2022-03-15T05:50:07.260087+0000","last_clean":"2022-03-15T05:50:07.260087+0000","last_became_active":"2022-03-15T05:50:01.758933+0000","last_became_peered":"2022-03-15T05:50:01.758933+0000","last_unstale":"2022-03-15T05:50:07.260087+0000","last_undegraded":"2022-03-15T05:50:07.260087+0000","last_fullsized":"2022-03-15T05:50:07.260087+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:07:34.261671+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266242+0000","last_change":"2022-03-15T05:49:56.021984+0000","last_active":"2022-03-15T05:50:02.266242+0000","last_peered":"2022-03-15T05:50:02.266242+0000","last_clean":"2022-03-15T05:50:02.266242+0000","last_became_active":"2022-03-15T05:49:56.021731+0000","last_became_peered":"2022-03-15T05:49:56.021731+0000","last_unstale":"2022-03-15T05:50:02.266242+0000","last_undegraded":"2022-03-15T05:50:02.266242+0000","last_fullsized":"2022-03-15T05:50:02.266242+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T07:28:10.949766+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.284752+0000","last_change":"2022-03-15T05:50:02.283078+0000","last_active":"2022-03-15T05:50:02.284752+0000","last_peered":"2022-03-15T05:50:02.284752+0000","last_clean":"2022-03-15T05:50:02.284752+0000","last_became_active":"2022-03-15T05:50:02.282773+0000","last_became_peered":"2022-03-15T05:50:02.282773+0000","last_unstale":"2022-03-15T05:50:02.284752+0000","last_undegraded":"2022-03-15T05:50:02.284752+0000","last_fullsized":"2022-03-15T05:50:02.284752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:30:20.154884+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.261311+0000","last_change":"2022-03-15T05:49:56.021748+0000","last_active":"2022-03-15T05:50:02.261311+0000","last_peered":"2022-03-15T05:50:02.261311+0000","last_clean":"2022-03-15T05:50:02.261311+0000","last_became_active":"2022-03-15T05:49:56.021377+0000","last_became_peered":"2022-03-15T05:49:56.021377+0000","last_unstale":"2022-03-15T05:50:02.261311+0000","last_undegraded":"2022-03-15T05:50:02.261311+0000","last_fullsized":"2022-03-15T05:50:02.261311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:49:54.701278+0000","last_clean_scrub_stamp":"2022-03-15T05:49:54.701278+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T12:26:22.203948+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.266443+0000","last_change":"2022-03-15T05:50:01.758476+0000","last_active":"2022-03-15T05:50:02.266443+0000","last_peered":"2022-03-15T05:50:02.266443+0000","last_clean":"2022-03-15T05:50:02.266443+0000","last_became_active":"2022-03-15T05:50:01.757859+0000","last_became_peered":"2022-03-15T05:50:01.757859+0000","last_unstale":"2022-03-15T05:50:02.266443+0000","last_undegraded":"2022-03-15T05:50:02.266443+0000","last_fullsized":"2022-03-15T05:50:02.266443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T17:18:49.740446+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279752+0000","last_change":"2022-03-15T05:50:02.271202+0000","last_active":"2022-03-15T05:50:02.279752+0000","last_peered":"2022-03-15T05:50:02.279752+0000","last_clean":"2022-03-15T05:50:02.279752+0000","last_became_active":"2022-03-15T05:50:02.270717+0000","last_became_peered":"2022-03-15T05:50:02.270717+0000","last_unstale":"2022-03-15T05:50:02.279752+0000","last_undegraded":"2022-03-15T05:50:02.279752+0000","last_fullsized":"2022-03-15T05:50:02.279752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:57:17.654890+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:04.344705+0000","last_change":"2022-03-15T05:50:01.768300+0000","last_active":"2022-03-15T05:50:04.344705+0000","last_peered":"2022-03-15T05:50:04.344705+0000","last_clean":"2022-03-15T05:50:04.344705+0000","last_became_active":"2022-03-15T05:50:01.767955+0000","last_became_peered":"2022-03-15T05:50:01.767955+0000","last_unstale":"2022-03-15T05:50:04.344705+0000","last_undegraded":"2022-03-15T05:50:04.344705+0000","last_fullsized":"2022-03-15T05:50:04.344705+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:10:41.738813+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280244+0000","last_change":"2022-03-15T05:50:02.276173+0000","last_active":"2022-03-15T05:50:02.280244+0000","last_peered":"2022-03-15T05:50:02.280244+0000","last_clean":"2022-03-15T05:50:02.280244+0000","last_became_active":"2022-03-15T05:50:02.275805+0000","last_became_peered":"2022-03-15T05:50:02.275805+0000","last_unstale":"2022-03-15T05:50:02.280244+0000","last_undegraded":"2022-03-15T05:50:02.280244+0000","last_fullsized":"2022-03-15T05:50:02.280244+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:20:32.284452+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.266612+0000","last_change":"2022-03-15T05:50:01.769303+0000","last_active":"2022-03-15T05:50:07.266612+0000","last_peered":"2022-03-15T05:50:07.266612+0000","last_clean":"2022-03-15T05:50:07.266612+0000","last_became_active":"2022-03-15T05:50:01.768420+0000","last_became_peered":"2022-03-15T05:50:01.768420+0000","last_unstale":"2022-03-15T05:50:07.266612+0000","last_undegraded":"2022-03-15T05:50:07.266612+0000","last_fullsized":"2022-03-15T05:50:07.266612+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:52:53.780299+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275161+0000","last_change":"2022-03-15T05:50:02.269010+0000","last_active":"2022-03-15T05:50:02.275161+0000","last_peered":"2022-03-15T05:50:02.275161+0000","last_clean":"2022-03-15T05:50:02.275161+0000","last_became_active":"2022-03-15T05:50:02.268702+0000","last_became_peered":"2022-03-15T05:50:02.268702+0000","last_unstale":"2022-03-15T05:50:02.275161+0000","last_undegraded":"2022-03-15T05:50:02.275161+0000","last_fullsized":"2022-03-15T05:50:02.275161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T11:21:36.546324+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"24'2","reported_seq":12,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.265743+0000","last_change":"2022-03-15T05:50:01.769060+0000","last_active":"2022-03-15T05:50:07.265743+0000","last_peered":"2022-03-15T05:50:07.265743+0000","last_clean":"2022-03-15T05:50:07.265743+0000","last_became_active":"2022-03-15T05:50:01.768832+0000","last_became_peered":"2022-03-15T05:50:01.768832+0000","last_unstale":"2022-03-15T05:50:07.265743+0000","last_undegraded":"2022-03-15T05:50:07.265743+0000","last_fullsized":"2022-03-15T05:50:07.265743+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:08:34.598986+0000","stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277210+0000","last_change":"2022-03-15T05:50:02.269955+0000","last_active":"2022-03-15T05:50:02.277210+0000","last_peered":"2022-03-15T05:50:02.277210+0000","last_clean":"2022-03-15T05:50:02.277210+0000","last_became_active":"2022-03-15T05:50:02.268808+0000","last_became_peered":"2022-03-15T05:50:02.268808+0000","last_unstale":"2022-03-15T05:50:02.277210+0000","last_undegraded":"2022-03-15T05:50:02.277210+0000","last_fullsized":"2022-03-15T05:50:02.277210+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T10:42:50.905588+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:04.172060+0000","last_change":"2022-03-15T05:50:01.758736+0000","last_active":"2022-03-15T05:50:04.172060+0000","last_peered":"2022-03-15T05:50:04.172060+0000","last_clean":"2022-03-15T05:50:04.172060+0000","last_became_active":"2022-03-15T05:50:01.758333+0000","last_became_peered":"2022-03-15T05:50:01.758333+0000","last_unstale":"2022-03-15T05:50:04.172060+0000","last_undegraded":"2022-03-15T05:50:04.172060+0000","last_fullsized":"2022-03-15T05:50:04.172060+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:58:43.148420+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277947+0000","last_change":"2022-03-15T05:50:02.269606+0000","last_active":"2022-03-15T05:50:02.277947+0000","last_peered":"2022-03-15T05:50:02.277947+0000","last_clean":"2022-03-15T05:50:02.277947+0000","last_became_active":"2022-03-15T05:50:02.268919+0000","last_became_peered":"2022-03-15T05:50:02.268919+0000","last_unstale":"2022-03-15T05:50:02.277947+0000","last_undegraded":"2022-03-15T05:50:02.277947+0000","last_fullsized":"2022-03-15T05:50:02.277947+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T14:07:44.276834+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"24'4","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2022-03-15T05:50:07.264391+0000","last_change":"2022-03-15T05:50:01.756439+0000","last_active":"2022-03-15T05:50:07.264391+0000","last_peered":"2022-03-15T05:50:07.264391+0000","last_clean":"2022-03-15T05:50:07.264391+0000","last_became_active":"2022-03-15T05:50:01.756088+0000","last_became_peered":"2022-03-15T05:50:01.756088+0000","last_unstale":"2022-03-15T05:50:07.264391+0000","last_undegraded":"2022-03-15T05:50:07.264391+0000","last_fullsized":"2022-03-15T05:50:07.264391+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:00.729997+0000","last_clean_scrub_stamp":"2022-03-15T05:50:00.729997+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:46:26.623500+0000","stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.275939+0000","last_change":"2022-03-15T05:50:02.271501+0000","last_active":"2022-03-15T05:50:02.275939+0000","last_peered":"2022-03-15T05:50:02.275939+0000","last_clean":"2022-03-15T05:50:02.275939+0000","last_became_active":"2022-03-15T05:50:02.271187+0000","last_became_peered":"2022-03-15T05:50:02.271187+0000","last_unstale":"2022-03-15T05:50:02.275939+0000","last_undegraded":"2022-03-15T05:50:02.275939+0000","last_fullsized":"2022-03-15T05:50:02.275939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T13:54:59.344451+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.279026+0000","last_change":"2022-03-15T05:50:02.274406+0000","last_active":"2022-03-15T05:50:02.279026+0000","last_peered":"2022-03-15T05:50:02.279026+0000","last_clean":"2022-03-15T05:50:02.279026+0000","last_became_active":"2022-03-15T05:50:02.274125+0000","last_became_peered":"2022-03-15T05:50:02.274125+0000","last_unstale":"2022-03-15T05:50:02.279026+0000","last_undegraded":"2022-03-15T05:50:02.279026+0000","last_fullsized":"2022-03-15T05:50:02.279026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T16:29:08.737054+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.277189+0000","last_change":"2022-03-15T05:50:02.272438+0000","last_active":"2022-03-15T05:50:02.277189+0000","last_peered":"2022-03-15T05:50:02.277189+0000","last_clean":"2022-03-15T05:50:02.277189+0000","last_became_active":"2022-03-15T05:50:02.272170+0000","last_became_peered":"2022-03-15T05:50:02.272170+0000","last_unstale":"2022-03-15T05:50:02.277189+0000","last_undegraded":"2022-03-15T05:50:02.277189+0000","last_fullsized":"2022-03-15T05:50:02.277189+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T15:48:35.986901+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.287816+0000","last_change":"2022-03-15T05:50:02.283839+0000","last_active":"2022-03-15T05:50:02.287816+0000","last_peered":"2022-03-15T05:50:02.287816+0000","last_clean":"2022-03-15T05:50:02.287816+0000","last_became_active":"2022-03-15T05:50:02.283609+0000","last_became_peered":"2022-03-15T05:50:02.283609+0000","last_unstale":"2022-03-15T05:50:02.287816+0000","last_undegraded":"2022-03-15T05:50:02.287816+0000","last_fullsized":"2022-03-15T05:50:02.287816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T09:12:07.158629+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.280963+0000","last_change":"2022-03-15T05:50:02.279440+0000","last_active":"2022-03-15T05:50:02.280963+0000","last_peered":"2022-03-15T05:50:02.280963+0000","last_clean":"2022-03-15T05:50:02.280963+0000","last_became_active":"2022-03-15T05:50:02.279161+0000","last_became_peered":"2022-03-15T05:50:02.279161+0000","last_unstale":"2022-03-15T05:50:02.280963+0000","last_undegraded":"2022-03-15T05:50:02.280963+0000","last_fullsized":"2022-03-15T05:50:02.280963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T08:51:31.533566+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2022-03-15T05:50:02.271955+0000","last_change":"2022-03-15T05:50:02.269218+0000","last_active":"2022-03-15T05:50:02.271955+0000","last_peered":"2022-03-15T05:50:02.271955+0000","last_clean":"2022-03-15T05:50:02.271955+0000","last_became_active":"2022-03-15T05:50:02.268768+0000","last_became_peered":"2022-03-15T05:50:02.268768+0000","last_unstale":"2022-03-15T05:50:02.271955+0000","last_undegraded":"2022-03-15T05:50:02.271955+0000","last_fullsized":"2022-03-15T05:50:02.271955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-15T05:50:01.735014+0000","last_clean_scrub_stamp":"2022-03-15T05:50:01.735014+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-03-16T06:17:44.234889+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2442,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":58,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":4862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48,"ondisk_log_size":48,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1064960,"data_stored":1057856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8012,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363828,"statfs":{"total":96636764160,"available":96628559872,"internally_reserved":0,"allocated":266240,"data_stored":93616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7940,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363900,"statfs":{"total":96636764160,"available":96628633600,"internally_reserved":0,"allocated":258048,"data_stored":93512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7970000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8260000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6880000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.7349999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8972,"kb_used_data":772,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94362868,"statfs":{"total":96636764160,"available":96627576832,"internally_reserved":0,"allocated":790528,"data_stored":621550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8004,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363836,"statfs":{"total":96636764160,"available":96628568064,"internally_reserved":0,"allocated":258048,"data_stored":92110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]}]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":91964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":91964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8960,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":8192,"kb_avail":94362880,"statfs":{"total":96636764160,"available":96627589120,"internally_reserved":0,"allocated":778240,"data_stored":619799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8388608},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70499999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4830000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]}]},{"osd":6,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7928,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363912,"statfs":{"total":96636764160,"available":96628645888,"internally_reserved":0,"allocated":245760,"data_stored":90395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.542}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6779999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-03-15T05:50:15.311 INFO:tasks.ceph.ceph_manager.ceph:clean! 2022-03-15T05:50:15.311 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-03-15T05:50:15.311 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2022-03-15T05:50:15.312 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2022-03-15T05:50:15.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.515+0000 7f845b600700 1 Processor -- start 2022-03-15T05:50:15.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.515+0000 7f845b600700 1 -- start start 2022-03-15T05:50:15.519 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.516+0000 7f845b600700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f84540c9b10 0x7f8454155f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.516+0000 7f845b600700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f84540aeb50 0x7f84541564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.516+0000 7f845b600700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8454155720 con 0x7f84540c8eb0 2022-03-15T05:50:15.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.516+0000 7f845b600700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845406c590 con 0x7f84540aeb50 2022-03-15T05:50:15.520 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.516+0000 7f845b600700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8454154b10 con 0x7f84540c9b10 2022-03-15T05:50:15.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.516+0000 7f8459b9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f84540aeb50 0x7f84541564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.516+0000 7f8458b9b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f84540c9b10 0x7f8454155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.516+0000 7f8459b9d700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f84540aeb50 0x7f84541564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60118/0 (socket says 172.21.15.151:60118) 2022-03-15T05:50:15.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.517+0000 7f8459b9d700 1 -- 172.21.15.151:0/1515908849 learned_addr learned my addr 172.21.15.151:0/1515908849 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:15.521 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.516+0000 7f845939c700 1 --1- 172.21.15.151:0/1515908849 >> v1:172.21.15.164:6789/0 conn(0x7f84540c8eb0 0x7f845414e8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33686/0 (socket says 172.21.15.151:33686) 2022-03-15T05:50:15.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.517+0000 7f8459b9d700 1 -- 172.21.15.151:0/1515908849 >> v2:172.21.15.164:3300/0 conn(0x7f84540c9b10 msgr2=0x7f8454155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:15.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.517+0000 7f8459b9d700 1 --2- 172.21.15.151:0/1515908849 >> v2:172.21.15.164:3300/0 conn(0x7f84540c9b10 0x7f8454155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.517+0000 7f8459b9d700 1 -- 172.21.15.151:0/1515908849 >> v1:172.21.15.164:6789/0 conn(0x7f84540c8eb0 legacy=0x7f845414e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.522 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.517+0000 7f8459b9d700 1 -- 172.21.15.151:0/1515908849 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8454154df0 con 0x7f84540aeb50 2022-03-15T05:50:15.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.517+0000 7f8443fff700 1 -- 172.21.15.151:0/1515908849 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463575403 0 0) 0x7f8454155720 con 0x7f84540c8eb0 2022-03-15T05:50:15.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.517+0000 7f8459b9d700 1 --2- 172.21.15.151:0/1515908849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 0x7f84541564a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f845406e200 tx=0x7f844c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9532d9e22671d33 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:15.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f8443fff700 1 -- 172.21.15.151:0/1515908849 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00e070 con 0x7f84540aeb50 2022-03-15T05:50:15.523 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f8443fff700 1 -- 172.21.15.151:0/1515908849 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c00ba20 con 0x7f84540aeb50 2022-03-15T05:50:15.524 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f8443fff700 1 -- 172.21.15.151:0/1515908849 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0092e0 con 0x7f84540aeb50 2022-03-15T05:50:15.527 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f845b600700 1 -- 172.21.15.151:0/1515908849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 msgr2=0x7f84541564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.527 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f845b600700 1 --2- 172.21.15.151:0/1515908849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 0x7f84541564a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f845406e200 tx=0x7f844c009840 comp rx=0 tx=0).stop 2022-03-15T05:50:15.528 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f845b600700 1 -- 172.21.15.151:0/1515908849 shutdown_connections 2022-03-15T05:50:15.528 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f845b600700 1 --2- 172.21.15.151:0/1515908849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 0x7f84541564a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.528 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f845b600700 1 --2- 172.21.15.151:0/1515908849 >> v2:172.21.15.164:3300/0 conn(0x7f84540c9b10 0x7f8454155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.528 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f845b600700 1 -- 172.21.15.151:0/1515908849 >> 172.21.15.151:0/1515908849 conn(0x7f845406e5c0 msgr2=0x7f845406e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:15.529 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f845b600700 1 -- 172.21.15.151:0/1515908849 shutdown_connections 2022-03-15T05:50:15.529 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.518+0000 7f845b600700 1 -- 172.21.15.151:0/1515908849 wait complete. 2022-03-15T05:50:15.529 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.520+0000 7f845b600700 1 Processor -- start 2022-03-15T05:50:15.529 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.520+0000 7f845b600700 1 -- start start 2022-03-15T05:50:15.529 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f845b600700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 0x7f8454150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.530 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f845b600700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84540c8eb0 0x7f8454164740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.530 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f845b600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84540c9b10 0x7f84540beb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.530 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f845b600700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845414fc10 con 0x7f84540aeb50 2022-03-15T05:50:15.530 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f845b600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540bfd00 con 0x7f84540c9b10 2022-03-15T05:50:15.531 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f845b600700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845415a520 con 0x7f84540c8eb0 2022-03-15T05:50:15.531 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f845939c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 0x7f8454150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.531 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f845939c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 0x7f8454150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60120/0 (socket says 172.21.15.151:60120) 2022-03-15T05:50:15.531 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f845939c700 1 -- 172.21.15.151:0/3722265706 learned_addr learned my addr 172.21.15.151:0/3722265706 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:15.531 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f8459b9d700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84540c9b10 0x7f84540beb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.532 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.521+0000 7f8458b9b700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84540c8eb0 0x7f8454164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.532 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f845939c700 1 -- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84540c8eb0 msgr2=0x7f8454164740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.532 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f845939c700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84540c8eb0 0x7f8454164740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.532 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f845939c700 1 -- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84540c9b10 msgr2=0x7f84540beb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.533 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f845939c700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84540c9b10 0x7f84540beb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.533 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f845939c700 1 -- 172.21.15.151:0/3722265706 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c009ae0 con 0x7f84540aeb50 2022-03-15T05:50:15.533 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f845939c700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 0x7f8454150ee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f845000c4e0 tx=0x7f8450007c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:15.533 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f84417fa700 1 -- 172.21.15.151:0/3722265706 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000ce90 con 0x7f84540aeb50 2022-03-15T05:50:15.533 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f84417fa700 1 -- 172.21.15.151:0/3722265706 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8450007360 con 0x7f84540aeb50 2022-03-15T05:50:15.534 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f84417fa700 1 -- 172.21.15.151:0/3722265706 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84500046b0 con 0x7f84540aeb50 2022-03-15T05:50:15.534 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f845b600700 1 -- 172.21.15.151:0/3722265706 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84541650c0 con 0x7f84540aeb50 2022-03-15T05:50:15.534 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.522+0000 7f845b600700 1 -- 172.21.15.151:0/3722265706 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84541653a0 con 0x7f84540aeb50 2022-03-15T05:50:15.534 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.523+0000 7f845b600700 1 -- 172.21.15.151:0/3722265706 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845415a9a0 con 0x7f84540aeb50 2022-03-15T05:50:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.524+0000 7f84417fa700 1 -- 172.21.15.151:0/3722265706 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f8450010030 con 0x7f84540aeb50 2022-03-15T05:50:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.525+0000 7f84417fa700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84340633c0 0x7f8434065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.525+0000 7f84417fa700 1 -- 172.21.15.151:0/3722265706 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f845007f7b0 con 0x7f84540aeb50 2022-03-15T05:50:15.535 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.525+0000 7f8458b9b700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84340633c0 0x7f8434065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:15.536 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.526+0000 7f8458b9b700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84340633c0 0x7f8434065870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8454153210 tx=0x7f8444009060 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:15.536 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.529+0000 7f84417fa700 1 -- 172.21.15.151:0/3722265706 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f845004e860 con 0x7f84540aeb50 2022-03-15T05:50:15.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.760+0000 7f845b600700 1 -- 172.21.15.151:0/3722265706 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f845404b760 con 0x7f84540aeb50 2022-03-15T05:50:15.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.760+0000 7f84417fa700 1 -- 172.21.15.151:0/3722265706 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8450051e80 con 0x7f84540aeb50 2022-03-15T05:50:15.763 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:15.763 INFO:teuthology.orchestra.run.smithi151.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-03-15T05:50:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.762+0000 7f845b600700 1 -- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84340633c0 msgr2=0x7f8434065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.762+0000 7f845b600700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84340633c0 0x7f8434065870 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8454153210 tx=0x7f8444009060 comp rx=0 tx=0).stop 2022-03-15T05:50:15.765 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.762+0000 7f845b600700 1 -- 172.21.15.151:0/3722265706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 msgr2=0x7f8454150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.762+0000 7f845b600700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 0x7f8454150ee0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f845000c4e0 tx=0x7f8450007c70 comp rx=0 tx=0).stop 2022-03-15T05:50:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.762+0000 7f845b600700 1 -- 172.21.15.151:0/3722265706 shutdown_connections 2022-03-15T05:50:15.766 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.762+0000 7f845b600700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f84340633c0 0x7f8434065870 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.763+0000 7f845b600700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84540c9b10 0x7f84540beb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.763+0000 7f845b600700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84540aeb50 0x7f8454150ee0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.763+0000 7f845b600700 1 --2- 172.21.15.151:0/3722265706 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f84540c8eb0 0x7f8454164740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:15.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.763+0000 7f845b600700 1 -- 172.21.15.151:0/3722265706 >> 172.21.15.151:0/3722265706 conn(0x7f845406e5c0 msgr2=0x7f8454152830 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:15.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.763+0000 7f845b600700 1 -- 172.21.15.151:0/3722265706 shutdown_connections 2022-03-15T05:50:15.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.763+0000 7f845b600700 1 -- 172.21.15.151:0/3722265706 wait complete. 2022-03-15T05:50:15.790 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2022-03-15T05:50:15.790 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-03-15T05:50:15.997 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.995+0000 7fc63eaf5700 1 Processor -- start 2022-03-15T05:50:15.997 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.995+0000 7fc63eaf5700 1 -- start start 2022-03-15T05:50:16.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.996+0000 7fc63eaf5700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6380acca0 0x7fc638066980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.000 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.996+0000 7fc63eaf5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6380c1800 0x7fc638066ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.996+0000 7fc63eaf5700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6380ad070 con 0x7fc638154a70 2022-03-15T05:50:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.996+0000 7fc63eaf5700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc638154480 con 0x7fc6380acca0 2022-03-15T05:50:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.996+0000 7fc63eaf5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc638153520 con 0x7fc6380c1800 2022-03-15T05:50:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.996+0000 7fc63daf3700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6380acca0 0x7fc638066980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.001 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.996+0000 7fc63e2f4700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fc638154a70 0x7fc638154f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53224/0 (socket says 172.21.15.151:53224) 2022-03-15T05:50:16.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.996+0000 7fc63e2f4700 1 -- 172.21.15.151:0/3629010670 learned_addr learned my addr 172.21.15.151:0/3629010670 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:16.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.996+0000 7fc63d2f2700 1 --2- 172.21.15.151:0/3629010670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6380c1800 0x7fc638066ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.997+0000 7fc63daf3700 1 -- 172.21.15.151:0/3629010670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6380c1800 msgr2=0x7fc638066ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:16.002 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.997+0000 7fc63daf3700 1 --2- 172.21.15.151:0/3629010670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6380c1800 0x7fc638066ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.997+0000 7fc63daf3700 1 -- 172.21.15.151:0/3629010670 >> v1:172.21.15.151:6789/0 conn(0x7fc638154a70 legacy=0x7fc638154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.997+0000 7fc63daf3700 1 -- 172.21.15.151:0/3629010670 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc638153800 con 0x7fc6380acca0 2022-03-15T05:50:16.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.997+0000 7fc63d2f2700 1 --2- 172.21.15.151:0/3629010670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6380c1800 0x7fc638066ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:16.003 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.997+0000 7fc63caf1700 1 -- 172.21.15.151:0/3629010670 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289561829 0 0) 0x7fc6380ad070 con 0x7fc638154a70 2022-03-15T05:50:16.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.997+0000 7fc63daf3700 1 --2- 172.21.15.151:0/3629010670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380acca0 0x7fc638066980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc634009760 tx=0x7fc634009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6532b01530c3551e server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:16.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.997+0000 7fc63caf1700 1 -- 172.21.15.151:0/3629010670 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634011630 con 0x7fc6380acca0 2022-03-15T05:50:16.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.997+0000 7fc63caf1700 1 -- 172.21.15.151:0/3629010670 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc634011790 con 0x7fc6380acca0 2022-03-15T05:50:16.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.997+0000 7fc63caf1700 1 -- 172.21.15.151:0/3629010670 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc634011b50 con 0x7fc6380acca0 2022-03-15T05:50:16.004 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.998+0000 7fc63eaf5700 1 -- 172.21.15.151:0/3629010670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380acca0 msgr2=0x7fc638066980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.998+0000 7fc63eaf5700 1 --2- 172.21.15.151:0/3629010670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380acca0 0x7fc638066980 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc634009760 tx=0x7fc634009060 comp rx=0 tx=0).stop 2022-03-15T05:50:16.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.998+0000 7fc63eaf5700 1 -- 172.21.15.151:0/3629010670 shutdown_connections 2022-03-15T05:50:16.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.998+0000 7fc63eaf5700 1 --2- 172.21.15.151:0/3629010670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380acca0 0x7fc638066980 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.005 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.998+0000 7fc63eaf5700 1 --2- 172.21.15.151:0/3629010670 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc6380c1800 0x7fc638066ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.998+0000 7fc63eaf5700 1 -- 172.21.15.151:0/3629010670 >> 172.21.15.151:0/3629010670 conn(0x7fc6380c3570 msgr2=0x7fc6380c3970 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:16.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.998+0000 7fc63eaf5700 1 -- 172.21.15.151:0/3629010670 shutdown_connections 2022-03-15T05:50:16.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:15.998+0000 7fc63eaf5700 1 -- 172.21.15.151:0/3629010670 wait complete. 2022-03-15T05:50:16.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.000+0000 7fc63eaf5700 1 Processor -- start 2022-03-15T05:50:16.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.000+0000 7fc63eaf5700 1 -- start start 2022-03-15T05:50:16.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63eaf5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6380acca0 0x7fc6381515b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63eaf5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380c1800 0x7fc638162c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63eaf5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc638154a70 0x7fc638163140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63eaf5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638167020 con 0x7fc6380c1800 2022-03-15T05:50:16.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63eaf5700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638166b90 con 0x7fc6380acca0 2022-03-15T05:50:16.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63eaf5700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380a7bc0 con 0x7fc638154a70 2022-03-15T05:50:16.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63d2f2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380c1800 0x7fc638162c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63d2f2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380c1800 0x7fc638162c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60124/0 (socket says 172.21.15.151:60124) 2022-03-15T05:50:16.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63d2f2700 1 -- 172.21.15.151:0/1094617139 learned_addr learned my addr 172.21.15.151:0/1094617139 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:16.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63daf3700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6380acca0 0x7fc6381515b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63e2f4700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc638154a70 0x7fc638163140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.001+0000 7fc63d2f2700 1 -- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc638154a70 msgr2=0x7fc638163140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.002+0000 7fc63d2f2700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc638154a70 0x7fc638163140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.002+0000 7fc63d2f2700 1 -- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6380acca0 msgr2=0x7fc6381515b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.002+0000 7fc63d2f2700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6380acca0 0x7fc6381515b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.002+0000 7fc63d2f2700 1 -- 172.21.15.151:0/1094617139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6280092a0 con 0x7fc6380c1800 2022-03-15T05:50:16.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.002+0000 7fc63d2f2700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380c1800 0x7fc638162c00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc62800ea80 tx=0x7fc628009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:16.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.002+0000 7fc625ffb700 1 -- 172.21.15.151:0/1094617139 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800ee60 con 0x7fc6380c1800 2022-03-15T05:50:16.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.002+0000 7fc625ffb700 1 -- 172.21.15.151:0/1094617139 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62800c850 con 0x7fc6380c1800 2022-03-15T05:50:16.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.002+0000 7fc625ffb700 1 -- 172.21.15.151:0/1094617139 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62800cc10 con 0x7fc6380c1800 2022-03-15T05:50:16.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.002+0000 7fc63eaf5700 1 -- 172.21.15.151:0/1094617139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6340092a0 con 0x7fc6380c1800 2022-03-15T05:50:16.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.002+0000 7fc63eaf5700 1 -- 172.21.15.151:0/1094617139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6380bdc10 con 0x7fc6380c1800 2022-03-15T05:50:16.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.003+0000 7fc63eaf5700 1 -- 172.21.15.151:0/1094617139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6380c6540 con 0x7fc6380c1800 2022-03-15T05:50:16.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.004+0000 7fc625ffb700 1 -- 172.21.15.151:0/1094617139 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7fc628019030 con 0x7fc6380c1800 2022-03-15T05:50:16.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.005+0000 7fc625ffb700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc6180633c0 0x7fc618065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.005+0000 7fc625ffb700 1 -- 172.21.15.151:0/1094617139 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc62807f920 con 0x7fc6380c1800 2022-03-15T05:50:16.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.006+0000 7fc63daf3700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc6180633c0 0x7fc618065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.006+0000 7fc63daf3700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc6180633c0 0x7fc618065870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc634009760 tx=0x7fc634017000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:16.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.009+0000 7fc625ffb700 1 -- 172.21.15.151:0/1094617139 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7fc62804e9b0 con 0x7fc6380c1800 2022-03-15T05:50:16.200 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.198+0000 7fc63eaf5700 1 -- 172.21.15.151:0/1094617139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc638068ed0 con 0x7fc6380c1800 2022-03-15T05:50:16.201 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.199+0000 7fc625ffb700 1 -- 172.21.15.151:0/1094617139 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16893 (secure 0 0 0) 0x7fc628017090 con 0x7fc6380c1800 2022-03-15T05:50:16.201 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:16.202 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":24,"fsid":"9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c","created":"2022-03-15T05:49:35.422375+0000","modified":"2022-03-15T05:50:03.251425+0000","last_up_change":"2022-03-15T05:49:47.305366+0000","last_in_change":"2022-03-15T05:49:38.010948+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2022-03-15T05:49:46.741897+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2022-03-15T05:49:54.617407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2022-03-15T05:49:59.845834+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2022-03-15T05:50:01.249141+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"48dd3bf6-c29e-4aad-9e07-bcc86b7a5acd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":35552},{"type":"v1","addr":"172.21.15.151:6801","nonce":35552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":35552},{"type":"v1","addr":"172.21.15.151:6803","nonce":35552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":35552},{"type":"v1","addr":"172.21.15.151:6807","nonce":35552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":35552},{"type":"v1","addr":"172.21.15.151:6805","nonce":35552}]},"public_addr":"172.21.15.151:6801/35552","cluster_addr":"172.21.15.151:6803/35552","heartbeat_back_addr":"172.21.15.151:6807/35552","heartbeat_front_addr":"172.21.15.151:6805/35552","state":["exists","up"]},{"osd":1,"uuid":"d9741252-6fc3-4bf2-a843-831bfa48368d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6819","nonce":35554},{"type":"v1","addr":"172.21.15.151:6821","nonce":35554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":35554},{"type":"v1","addr":"172.21.15.151:6825","nonce":35554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":35554},{"type":"v1","addr":"172.21.15.151:6831","nonce":35554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6827","nonce":35554},{"type":"v1","addr":"172.21.15.151:6829","nonce":35554}]},"public_addr":"172.21.15.151:6821/35554","cluster_addr":"172.21.15.151:6825/35554","heartbeat_back_addr":"172.21.15.151:6831/35554","heartbeat_front_addr":"172.21.15.151:6829/35554","state":["exists","up"]},{"osd":2,"uuid":"3ae506ea-a48a-4186-a0ff-0d9e6754eac2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":35555},{"type":"v1","addr":"172.21.15.151:6817","nonce":35555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":35555},{"type":"v1","addr":"172.21.15.151:6820","nonce":35555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":35555},{"type":"v1","addr":"172.21.15.151:6828","nonce":35555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":35555},{"type":"v1","addr":"172.21.15.151:6824","nonce":35555}]},"public_addr":"172.21.15.151:6817/35555","cluster_addr":"172.21.15.151:6820/35555","heartbeat_back_addr":"172.21.15.151:6828/35555","heartbeat_front_addr":"172.21.15.151:6824/35555","state":["exists","up"]},{"osd":3,"uuid":"1a9e746f-be84-4d51-9e1b-c6a3eeadf0f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":35553},{"type":"v1","addr":"172.21.15.151:6809","nonce":35553}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":35553},{"type":"v1","addr":"172.21.15.151:6811","nonce":35553}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":35553},{"type":"v1","addr":"172.21.15.151:6815","nonce":35553}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":35553},{"type":"v1","addr":"172.21.15.151:6813","nonce":35553}]},"public_addr":"172.21.15.151:6809/35553","cluster_addr":"172.21.15.151:6811/35553","heartbeat_back_addr":"172.21.15.151:6815/35553","heartbeat_front_addr":"172.21.15.151:6813/35553","state":["exists","up"]},{"osd":4,"uuid":"2cd04560-8f2e-4cd2-997a-e79c8d2b9bef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":41130},{"type":"v1","addr":"172.21.15.164:6825","nonce":41130}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":41130},{"type":"v1","addr":"172.21.15.164:6827","nonce":41130}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":41130},{"type":"v1","addr":"172.21.15.164:6831","nonce":41130}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":41130},{"type":"v1","addr":"172.21.15.164:6829","nonce":41130}]},"public_addr":"172.21.15.164:6825/41130","cluster_addr":"172.21.15.164:6827/41130","heartbeat_back_addr":"172.21.15.164:6831/41130","heartbeat_front_addr":"172.21.15.164:6829/41130","state":["exists","up"]},{"osd":5,"uuid":"2ef0ce5d-53d2-4270-8d2c-5a361f043243","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":41119},{"type":"v1","addr":"172.21.15.164:6801","nonce":41119}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":41119},{"type":"v1","addr":"172.21.15.164:6803","nonce":41119}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":41119},{"type":"v1","addr":"172.21.15.164:6807","nonce":41119}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":41119},{"type":"v1","addr":"172.21.15.164:6805","nonce":41119}]},"public_addr":"172.21.15.164:6801/41119","cluster_addr":"172.21.15.164:6803/41119","heartbeat_back_addr":"172.21.15.164:6807/41119","heartbeat_front_addr":"172.21.15.164:6805/41119","state":["exists","up"]},{"osd":6,"uuid":"0c37ca28-6713-4176-8680-5fa03fe4d2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":41129},{"type":"v1","addr":"172.21.15.164:6817","nonce":41129}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":41129},{"type":"v1","addr":"172.21.15.164:6819","nonce":41129}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":41129},{"type":"v1","addr":"172.21.15.164:6823","nonce":41129}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":41129},{"type":"v1","addr":"172.21.15.164:6821","nonce":41129}]},"public_addr":"172.21.15.164:6817/41129","cluster_addr":"172.21.15.164:6819/41129","heartbeat_back_addr":"172.21.15.164:6823/41129","heartbeat_front_addr":"172.21.15.164:6821/41129","state":["exists","up"]},{"osd":7,"uuid":"3ed8d241-1f34-400f-b33e-a8cfb1132fca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":41120},{"type":"v1","addr":"172.21.15.164:6809","nonce":41120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":41120},{"type":"v1","addr":"172.21.15.164:6811","nonce":41120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6815","nonce":41120},{"type":"v1","addr":"172.21.15.164:6816","nonce":41120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":41120},{"type":"v1","addr":"172.21.15.164:6813","nonce":41120}]},"public_addr":"172.21.15.164:6809/41120","cluster_addr":"172.21.15.164:6811/41120","heartbeat_back_addr":"172.21.15.164:6816/41120","heartbeat_front_addr":"172.21.15.164:6813/41120","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.378836+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.466901+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.764352+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.688587+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.304917+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.236409+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.231122+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2022-03-15T05:49:43.208581+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-15T05:50:16.204 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.201+0000 7fc63eaf5700 1 -- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc6180633c0 msgr2=0x7fc618065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.204 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.201+0000 7fc63eaf5700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc6180633c0 0x7fc618065870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fc634009760 tx=0x7fc634017000 comp rx=0 tx=0).stop 2022-03-15T05:50:16.204 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.201+0000 7fc63eaf5700 1 -- 172.21.15.151:0/1094617139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380c1800 msgr2=0x7fc638162c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.205 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.201+0000 7fc63eaf5700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380c1800 0x7fc638162c00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc62800ea80 tx=0x7fc628009060 comp rx=0 tx=0).stop 2022-03-15T05:50:16.205 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.202+0000 7fc63eaf5700 1 -- 172.21.15.151:0/1094617139 shutdown_connections 2022-03-15T05:50:16.205 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.202+0000 7fc63eaf5700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7fc6180633c0 0x7fc618065870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.205 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.202+0000 7fc63eaf5700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7fc638154a70 0x7fc638163140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.206 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.202+0000 7fc63eaf5700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6380acca0 0x7fc6381515b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.206 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.202+0000 7fc63eaf5700 1 --2- 172.21.15.151:0/1094617139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6380c1800 0x7fc638162c00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.206 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.202+0000 7fc63eaf5700 1 -- 172.21.15.151:0/1094617139 >> 172.21.15.151:0/1094617139 conn(0x7fc6380c3570 msgr2=0x7fc6380c1d00 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:16.206 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.202+0000 7fc63eaf5700 1 -- 172.21.15.151:0/1094617139 shutdown_connections 2022-03-15T05:50:16.207 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.202+0000 7fc63eaf5700 1 -- 172.21.15.151:0/1094617139 wait complete. 2022-03-15T05:50:16.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2022-03-15T05:49:46.741897+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2022-03-15T05:49:54.617407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2022-03-15T05:49:59.845834+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2022-03-15T05:50:01.249141+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2022-03-15T05:50:16.229 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2022-03-15T05:50:16.437 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.435+0000 7f908a2b2700 1 Processor -- start 2022-03-15T05:50:16.438 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.435+0000 7f908a2b2700 1 -- start start 2022-03-15T05:50:16.441 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908a2b2700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9084157a20 0x7f9084155800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.441 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908a2b2700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f90840c2db0 0x7f90840c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.442 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908a2b2700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90840c5c70 con 0x7f9084157df0 2022-03-15T05:50:16.442 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908a2b2700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90840c2920 con 0x7f90840c2db0 2022-03-15T05:50:16.442 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908a2b2700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9084155d40 con 0x7f9084157a20 2022-03-15T05:50:16.442 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908884f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f90840c2db0 0x7f90840c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.443 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908884f700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f90840c2db0 0x7f90840c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60126/0 (socket says 172.21.15.151:60126) 2022-03-15T05:50:16.443 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908884f700 1 -- 172.21.15.151:0/1787737483 learned_addr learned my addr 172.21.15.151:0/1787737483 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:16.443 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f90837fe700 1 --1- 172.21.15.151:0/1787737483 >> v1:172.21.15.151:6789/0 conn(0x7f9084157df0 0x7f90840cb050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53228/0 (socket says 172.21.15.151:53228) 2022-03-15T05:50:16.443 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f9083fff700 1 --2- 172.21.15.151:0/1787737483 >> v2:172.21.15.164:3300/0 conn(0x7f9084157a20 0x7f9084155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.444 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908884f700 1 -- 172.21.15.151:0/1787737483 >> v2:172.21.15.164:3300/0 conn(0x7f9084157a20 msgr2=0x7f9084155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:16.444 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908884f700 1 --2- 172.21.15.151:0/1787737483 >> v2:172.21.15.164:3300/0 conn(0x7f9084157a20 0x7f9084155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.444 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908884f700 1 -- 172.21.15.151:0/1787737483 >> v1:172.21.15.151:6789/0 conn(0x7f9084157df0 legacy=0x7f90840cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.444 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.437+0000 7f908884f700 1 -- 172.21.15.151:0/1787737483 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90840cb850 con 0x7f90840c2db0 2022-03-15T05:50:16.444 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.438+0000 7f908884f700 1 --2- 172.21.15.151:0/1787737483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90840c2db0 0x7f90840c4b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9084088490 tx=0x7f907c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4253972ff51e2c server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:16.445 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.438+0000 7f9082ffd700 1 -- 172.21.15.151:0/1787737483 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c00e070 con 0x7f90840c2db0 2022-03-15T05:50:16.445 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.438+0000 7f9082ffd700 1 -- 172.21.15.151:0/1787737483 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f907c00ba20 con 0x7f90840c2db0 2022-03-15T05:50:16.445 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.438+0000 7f9082ffd700 1 -- 172.21.15.151:0/1787737483 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f907c0092e0 con 0x7f90840c2db0 2022-03-15T05:50:16.445 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.438+0000 7f908a2b2700 1 -- 172.21.15.151:0/1787737483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90840c2db0 msgr2=0x7f90840c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.446 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.438+0000 7f908a2b2700 1 --2- 172.21.15.151:0/1787737483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90840c2db0 0x7f90840c4b10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f9084088490 tx=0x7f907c009840 comp rx=0 tx=0).stop 2022-03-15T05:50:16.446 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.439+0000 7f908a2b2700 1 -- 172.21.15.151:0/1787737483 shutdown_connections 2022-03-15T05:50:16.446 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.439+0000 7f908a2b2700 1 --2- 172.21.15.151:0/1787737483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90840c2db0 0x7f90840c4b10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.446 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.439+0000 7f908a2b2700 1 --2- 172.21.15.151:0/1787737483 >> v2:172.21.15.164:3300/0 conn(0x7f9084157a20 0x7f9084155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.446 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.439+0000 7f908a2b2700 1 -- 172.21.15.151:0/1787737483 >> 172.21.15.151:0/1787737483 conn(0x7f9084068ec0 msgr2=0x7f90840692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:16.447 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.439+0000 7f908a2b2700 1 -- 172.21.15.151:0/1787737483 shutdown_connections 2022-03-15T05:50:16.447 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.439+0000 7f908a2b2700 1 -- 172.21.15.151:0/1787737483 wait complete. 2022-03-15T05:50:16.450 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.441+0000 7f908a2b2700 1 Processor -- start 2022-03-15T05:50:16.450 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.441+0000 7f908a2b2700 1 -- start start 2022-03-15T05:50:16.450 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.442+0000 7f908a2b2700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90840c2db0 0x7f908414a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.442+0000 7f908a2b2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9084157a20 0x7f90840c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.442+0000 7f908a2b2700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9084157df0 0x7f9084145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.442+0000 7f908a2b2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9084153ae0 con 0x7f9084157a20 2022-03-15T05:50:16.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.442+0000 7f908a2b2700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90840c6c20 con 0x7f90840c2db0 2022-03-15T05:50:16.451 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.442+0000 7f908a2b2700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90840b0a30 con 0x7f9084157df0 2022-03-15T05:50:16.452 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f90837fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9084157a20 0x7f90840c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.452 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f9083fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90840c2db0 0x7f908414a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.452 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f9083fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90840c2db0 0x7f908414a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57334/0 (socket says 172.21.15.151:57334) 2022-03-15T05:50:16.452 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f9083fff700 1 -- 172.21.15.151:0/4231746167 learned_addr learned my addr 172.21.15.151:0/4231746167 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:16.453 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f908884f700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9084157df0 0x7f9084145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.453 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f9083fff700 1 -- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9084157df0 msgr2=0x7f9084145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.453 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f9083fff700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9084157df0 0x7f9084145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.453 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f9083fff700 1 -- 172.21.15.151:0/4231746167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9084157a20 msgr2=0x7f90840c76c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.453 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f9083fff700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9084157a20 0x7f90840c76c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.454 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f9083fff700 1 -- 172.21.15.151:0/4231746167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f907c009ae0 con 0x7f90840c2db0 2022-03-15T05:50:16.454 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.443+0000 7f90837fe700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9084157a20 0x7f90840c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:16.454 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.444+0000 7f9083fff700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90840c2db0 0x7f908414a530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f907400e930 tx=0x7f9074009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:16.454 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.444+0000 7f906bfff700 1 -- 172.21.15.151:0/4231746167 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074013680 con 0x7f90840c2db0 2022-03-15T05:50:16.455 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.444+0000 7f906bfff700 1 -- 172.21.15.151:0/4231746167 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90740137e0 con 0x7f90840c2db0 2022-03-15T05:50:16.455 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.444+0000 7f908a2b2700 1 -- 172.21.15.151:0/4231746167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90840af730 con 0x7f90840c2db0 2022-03-15T05:50:16.455 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.444+0000 7f906bfff700 1 -- 172.21.15.151:0/4231746167 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9074013b60 con 0x7f90840c2db0 2022-03-15T05:50:16.455 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.444+0000 7f908a2b2700 1 -- 172.21.15.151:0/4231746167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90840c6ec0 con 0x7f90840c2db0 2022-03-15T05:50:16.455 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.445+0000 7f908a2b2700 1 -- 172.21.15.151:0/4231746167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f908404b760 con 0x7f90840c2db0 2022-03-15T05:50:16.456 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.446+0000 7f906bfff700 1 -- 172.21.15.151:0/4231746167 <== mon.1 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f9074019030 con 0x7f90840c2db0 2022-03-15T05:50:16.456 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.447+0000 7f906bfff700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f90640633c0 0x7f9064065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.456 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.447+0000 7f906bfff700 1 -- 172.21.15.151:0/4231746167 <== mon.1 v2:172.21.15.164:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f907407fa60 con 0x7f90840c2db0 2022-03-15T05:50:16.456 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.447+0000 7f90837fe700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f90640633c0 0x7f9064065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.457 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.448+0000 7f90837fe700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f90640633c0 0x7f9064065870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f908414e180 tx=0x7f9078007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:16.457 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.451+0000 7f906bfff700 1 -- 172.21.15.151:0/4231746167 <== mon.1 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f907404eaf0 con 0x7f90840c2db0 2022-03-15T05:50:16.636 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.633+0000 7f908a2b2700 1 -- 172.21.15.151:0/4231746167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90840c9b50 con 0x7f90840c2db0 2022-03-15T05:50:16.636 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.634+0000 7f906bfff700 1 -- 172.21.15.151:0/4231746167 <== mon.1 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9074017020 con 0x7f90840c2db0 2022-03-15T05:50:16.637 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2022-03-15T05:50:16.639 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 -- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f90640633c0 msgr2=0x7f9064065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.639 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f90640633c0 0x7f9064065870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f908414e180 tx=0x7f9078007d30 comp rx=0 tx=0).stop 2022-03-15T05:50:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 -- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90840c2db0 msgr2=0x7f908414a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90840c2db0 0x7f908414a530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f907400e930 tx=0x7f9074009060 comp rx=0 tx=0).stop 2022-03-15T05:50:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 -- 172.21.15.151:0/4231746167 shutdown_connections 2022-03-15T05:50:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f90640633c0 0x7f9064065870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9084157df0 0x7f9084145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90840c2db0 0x7f908414a530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 --2- 172.21.15.151:0/4231746167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9084157a20 0x7f90840c76c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 -- 172.21.15.151:0/4231746167 >> 172.21.15.151:0/4231746167 conn(0x7f9084068ec0 msgr2=0x7f90840c51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 -- 172.21.15.151:0/4231746167 shutdown_connections 2022-03-15T05:50:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.637+0000 7f908a2b2700 1 -- 172.21.15.151:0/4231746167 wait complete. 2022-03-15T05:50:16.665 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2022-03-15T05:50:16.871 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T05:50:16.869+0000 7f18de513700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2022-03-15T05:50:16.871 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T05:50:16.869+0000 7f18de513700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2022-03-15T05:50:16.875 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.873+0000 7f2811d61700 1 Processor -- start 2022-03-15T05:50:16.876 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.874+0000 7f2811d61700 1 -- start start 2022-03-15T05:50:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.875+0000 7f2811d61700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f280c157df0 0x7f280c155800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.875+0000 7f2811d61700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 0x7f280c0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.875+0000 7f2811d61700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f280c0c5c70 con 0x7f280c157a20 2022-03-15T05:50:16.878 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.875+0000 7f2811d61700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f280c0c2920 con 0x7f280c157df0 2022-03-15T05:50:16.878 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.875+0000 7f2811d61700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c155d40 con 0x7f280c0c2db0 2022-03-15T05:50:16.878 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.875+0000 7f280bfff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 0x7f280c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.878 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.875+0000 7f280affd700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f280c157df0 0x7f280c155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.879 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.875+0000 7f280b7fe700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f280c157a20 0x7f280c0cb050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33688/0 (socket says 172.21.15.151:33688) 2022-03-15T05:50:16.879 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.875+0000 7f280b7fe700 1 -- 172.21.15.151:0/1126039944 learned_addr learned my addr 172.21.15.151:0/1126039944 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:16.881 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.876+0000 7f280a7fc700 1 -- 172.21.15.151:0/1126039944 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2267212399 0 0) 0x7f280c0c5c70 con 0x7f280c157a20 2022-03-15T05:50:16.881 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.876+0000 7f280a7fc700 1 -- 172.21.15.151:0/1126039944 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f80033f0 con 0x7f280c157a20 2022-03-15T05:50:16.882 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.876+0000 7f280affd700 1 -- 172.21.15.151:0/1126039944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 msgr2=0x7f280c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:16.882 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.876+0000 7f280affd700 1 --2- 172.21.15.151:0/1126039944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 0x7f280c0c4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.882 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.876+0000 7f280affd700 1 -- 172.21.15.151:0/1126039944 >> v1:172.21.15.164:6789/0 conn(0x7f280c157a20 legacy=0x7f280c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.882 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.876+0000 7f280affd700 1 -- 172.21.15.151:0/1126039944 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c0cb850 con 0x7f280c157df0 2022-03-15T05:50:16.883 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.876+0000 7f280affd700 1 --2- 172.21.15.151:0/1126039944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c157df0 0x7f280c155800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2800009760 tx=0x7f2800009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afdf0209f484767b server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:16.883 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.876+0000 7f280a7fc700 1 -- 172.21.15.151:0/1126039944 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28000105b0 con 0x7f280c157df0 2022-03-15T05:50:16.883 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.876+0000 7f280a7fc700 1 -- 172.21.15.151:0/1126039944 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2800010710 con 0x7f280c157df0 2022-03-15T05:50:16.883 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.876+0000 7f280a7fc700 1 -- 172.21.15.151:0/1126039944 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800010ab0 con 0x7f280c157df0 2022-03-15T05:50:16.884 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.877+0000 7f2811d61700 1 -- 172.21.15.151:0/1126039944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c157df0 msgr2=0x7f280c155800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.884 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.877+0000 7f2811d61700 1 --2- 172.21.15.151:0/1126039944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c157df0 0x7f280c155800 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2800009760 tx=0x7f2800009060 comp rx=0 tx=0).stop 2022-03-15T05:50:16.884 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.877+0000 7f2811d61700 1 -- 172.21.15.151:0/1126039944 shutdown_connections 2022-03-15T05:50:16.884 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.877+0000 7f2811d61700 1 --2- 172.21.15.151:0/1126039944 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 0x7f280c0c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.885 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.877+0000 7f2811d61700 1 --2- 172.21.15.151:0/1126039944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c157df0 0x7f280c155800 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.885 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.877+0000 7f2811d61700 1 -- 172.21.15.151:0/1126039944 >> 172.21.15.151:0/1126039944 conn(0x7f280c068ec0 msgr2=0x7f280c0692c0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:16.885 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.877+0000 7f2811d61700 1 -- 172.21.15.151:0/1126039944 shutdown_connections 2022-03-15T05:50:16.885 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.877+0000 7f2811d61700 1 -- 172.21.15.151:0/1126039944 wait complete. 2022-03-15T05:50:16.885 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.879+0000 7f2811d61700 1 Processor -- start 2022-03-15T05:50:16.886 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.879+0000 7f2811d61700 1 -- start start 2022-03-15T05:50:16.889 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f2811d61700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 0x7f280c151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.889 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f2811d61700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f280c157a20 0x7f280c16c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.889 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f2811d61700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c157df0 0x7f280c16ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.890 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f2811d61700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0cac00 con 0x7f280c157a20 2022-03-15T05:50:16.890 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f2811d61700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0b0850 con 0x7f280c157df0 2022-03-15T05:50:16.890 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f2811d61700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0ca5f0 con 0x7f280c0c2db0 2022-03-15T05:50:16.890 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f280b7fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 0x7f280c151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.891 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f280affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f280c157a20 0x7f280c16c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.891 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f280bfff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c157df0 0x7f280c16ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.891 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f280b7fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 0x7f280c151a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60242/0 (socket says 172.21.15.151:60242) 2022-03-15T05:50:16.891 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.881+0000 7f280b7fe700 1 -- 172.21.15.151:0/2484563945 learned_addr learned my addr 172.21.15.151:0/2484563945 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:16.892 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f280b7fe700 1 -- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c157df0 msgr2=0x7f280c16ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.892 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f280b7fe700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c157df0 0x7f280c16ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.892 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f280b7fe700 1 -- 172.21.15.151:0/2484563945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f280c157a20 msgr2=0x7f280c16c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:16.892 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f280b7fe700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f280c157a20 0x7f280c16c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:16.892 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f280b7fe700 1 -- 172.21.15.151:0/2484563945 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28000092a0 con 0x7f280c0c2db0 2022-03-15T05:50:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f280affd700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f280c157a20 0x7f280c16c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f280b7fe700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 0x7f280c151a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00c440 tx=0x7f27fc007c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f27f37fe700 1 -- 172.21.15.151:0/2484563945 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00ce40 con 0x7f280c0c2db0 2022-03-15T05:50:16.893 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f27f37fe700 1 -- 172.21.15.151:0/2484563945 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc0072e0 con 0x7f280c0c2db0 2022-03-15T05:50:16.894 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f27f37fe700 1 -- 172.21.15.151:0/2484563945 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc005780 con 0x7f280c0c2db0 2022-03-15T05:50:16.894 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f2811d61700 1 -- 172.21.15.151:0/2484563945 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f280c169860 con 0x7f280c0c2db0 2022-03-15T05:50:16.894 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.882+0000 7f2811d61700 1 -- 172.21.15.151:0/2484563945 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f280c0c78f0 con 0x7f280c0c2db0 2022-03-15T05:50:16.894 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.883+0000 7f2811d61700 1 -- 172.21.15.151:0/2484563945 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280c04b760 con 0x7f280c0c2db0 2022-03-15T05:50:16.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.884+0000 7f27f37fe700 1 -- 172.21.15.151:0/2484563945 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f27fc019030 con 0x7f280c0c2db0 2022-03-15T05:50:16.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.885+0000 7f27f37fe700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f27ec0633c0 0x7f27ec065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:16.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.885+0000 7f27f37fe700 1 -- 172.21.15.151:0/2484563945 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f27fc07eef0 con 0x7f280c0c2db0 2022-03-15T05:50:16.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.885+0000 7f280affd700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f27ec0633c0 0x7f27ec065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:16.895 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.886+0000 7f280affd700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f27ec0633c0 0x7f27ec065870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2800007fd0 tx=0x7f2800016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:16.896 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:16.889+0000 7f27f37fe700 1 -- 172.21.15.151:0/2484563945 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f27fc04df80 con 0x7f280c0c2db0 2022-03-15T05:50:17.077 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.075+0000 7f2811d61700 1 -- 172.21.15.151:0/2484563945 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f280c0cae30 con 0x7f280c0c2db0 2022-03-15T05:50:17.078 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.076+0000 7f27f37fe700 1 -- 172.21.15.151:0/2484563945 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f27fc017070 con 0x7f280c0c2db0 2022-03-15T05:50:17.078 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 8 2022-03-15T05:50:17.081 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.078+0000 7f2811d61700 1 -- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f27ec0633c0 msgr2=0x7f27ec065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.081 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.078+0000 7f2811d61700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f27ec0633c0 0x7f27ec065870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2800007fd0 tx=0x7f2800016000 comp rx=0 tx=0).stop 2022-03-15T05:50:17.082 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.079+0000 7f2811d61700 1 -- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 msgr2=0x7f280c151a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.082 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.079+0000 7f2811d61700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 0x7f280c151a70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f27fc00c440 tx=0x7f27fc007c70 comp rx=0 tx=0).stop 2022-03-15T05:50:17.082 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.079+0000 7f2811d61700 1 -- 172.21.15.151:0/2484563945 shutdown_connections 2022-03-15T05:50:17.082 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.079+0000 7f2811d61700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f27ec0633c0 0x7f27ec065870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.079+0000 7f2811d61700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f280c157df0 0x7f280c16ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.079+0000 7f2811d61700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f280c0c2db0 0x7f280c151a70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.079+0000 7f2811d61700 1 --2- 172.21.15.151:0/2484563945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f280c157a20 0x7f280c16c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.083 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.079+0000 7f2811d61700 1 -- 172.21.15.151:0/2484563945 >> 172.21.15.151:0/2484563945 conn(0x7f280c068ec0 msgr2=0x7f280c0c6720 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:17.084 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.079+0000 7f2811d61700 1 -- 172.21.15.151:0/2484563945 shutdown_connections 2022-03-15T05:50:17.084 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.079+0000 7f2811d61700 1 -- 172.21.15.151:0/2484563945 wait complete. 2022-03-15T05:50:17.105 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2022-03-15T05:50:17.315 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.313+0000 7f9f0359e700 1 Processor -- start 2022-03-15T05:50:17.315 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.313+0000 7f9f0359e700 1 -- start start 2022-03-15T05:50:17.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.314+0000 7f9f0359e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9f040c1930 0x7f9f04068080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.314+0000 7f9f0359e700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f9f040c5a00 0x7f9f040bf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.314+0000 7f9f0359e700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f040c0120 con 0x7f9f040c1d00 2022-03-15T05:50:17.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.314+0000 7f9f0359e700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f04067bf0 con 0x7f9f040c1930 2022-03-15T05:50:17.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.314+0000 7f9f0359e700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f040bfb60 con 0x7f9f040c5a00 2022-03-15T05:50:17.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.315+0000 7f9f0259c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9f040c1930 0x7f9f04068080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.315+0000 7f9f0259c700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9f040c1930 0x7f9f04068080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60132/0 (socket says 172.21.15.151:60132) 2022-03-15T05:50:17.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.315+0000 7f9f0259c700 1 -- 172.21.15.151:0/2894615659 learned_addr learned my addr 172.21.15.151:0/2894615659 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:17.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.315+0000 7f9f02d9d700 1 --1- 172.21.15.151:0/2894615659 >> v1:172.21.15.151:6789/0 conn(0x7f9f040c1d00 0x7f9f0414e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53230/0 (socket says 172.21.15.151:53230) 2022-03-15T05:50:17.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.315+0000 7f9f01d9b700 1 --2- 172.21.15.151:0/2894615659 >> v2:172.21.15.164:3300/0 conn(0x7f9f040c5a00 0x7f9f040bf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.315+0000 7f9f0259c700 1 -- 172.21.15.151:0/2894615659 >> v2:172.21.15.164:3300/0 conn(0x7f9f040c5a00 msgr2=0x7f9f040bf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:17.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.315+0000 7f9f0259c700 1 --2- 172.21.15.151:0/2894615659 >> v2:172.21.15.164:3300/0 conn(0x7f9f040c5a00 0x7f9f040bf060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.315+0000 7f9f0259c700 1 -- 172.21.15.151:0/2894615659 >> v1:172.21.15.151:6789/0 conn(0x7f9f040c1d00 legacy=0x7f9f0414e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.315+0000 7f9f0259c700 1 -- 172.21.15.151:0/2894615659 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f040bfe40 con 0x7f9f040c1930 2022-03-15T05:50:17.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.315+0000 7f9f0259c700 1 --2- 172.21.15.151:0/2894615659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c1930 0x7f9f04068080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9f04089100 tx=0x7f9ef40090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc28c35bbfe9907 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:17.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0159a700 1 -- 172.21.15.151:0/2894615659 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4004030 con 0x7f9f040c1930 2022-03-15T05:50:17.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0159a700 1 -- 172.21.15.151:0/2894615659 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef4004190 con 0x7f9f040c1930 2022-03-15T05:50:17.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0159a700 1 -- 172.21.15.151:0/2894615659 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef4011630 con 0x7f9f040c1930 2022-03-15T05:50:17.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0359e700 1 -- 172.21.15.151:0/2894615659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c1930 msgr2=0x7f9f04068080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0359e700 1 --2- 172.21.15.151:0/2894615659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c1930 0x7f9f04068080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9f04089100 tx=0x7f9ef40090f0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0359e700 1 -- 172.21.15.151:0/2894615659 shutdown_connections 2022-03-15T05:50:17.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0359e700 1 --2- 172.21.15.151:0/2894615659 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c1930 0x7f9f04068080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0359e700 1 --2- 172.21.15.151:0/2894615659 >> v2:172.21.15.164:3300/0 conn(0x7f9f040c5a00 0x7f9f040bf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0359e700 1 -- 172.21.15.151:0/2894615659 >> 172.21.15.151:0/2894615659 conn(0x7f9f04062490 msgr2=0x7f9f04062890 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0359e700 1 -- 172.21.15.151:0/2894615659 shutdown_connections 2022-03-15T05:50:17.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.316+0000 7f9f0359e700 1 -- 172.21.15.151:0/2894615659 wait complete. 2022-03-15T05:50:17.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.318+0000 7f9f0359e700 1 Processor -- start 2022-03-15T05:50:17.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.318+0000 7f9f0359e700 1 -- start start 2022-03-15T05:50:17.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.319+0000 7f9f0359e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f040c1930 0x7f9f04157870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.319+0000 7f9f0359e700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f040c1d00 0x7f9f040cb260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.319+0000 7f9f0359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c5a00 0x7f9f04146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.319+0000 7f9f0359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040c2b50 con 0x7f9f040c5a00 2022-03-15T05:50:17.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.319+0000 7f9f0359e700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f04152c70 con 0x7f9f040c1d00 2022-03-15T05:50:17.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.319+0000 7f9f0359e700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f04156e20 con 0x7f9f040c1930 2022-03-15T05:50:17.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.319+0000 7f9f02d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c5a00 0x7f9f04146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f02d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c5a00 0x7f9f04146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60134/0 (socket says 172.21.15.151:60134) 2022-03-15T05:50:17.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f0259c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f040c1930 0x7f9f04157870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f01d9b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f040c1d00 0x7f9f040cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f02d9d700 1 -- 172.21.15.151:0/1346605707 learned_addr learned my addr 172.21.15.151:0/1346605707 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:17.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f02d9d700 1 -- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f040c1930 msgr2=0x7f9f04157870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f02d9d700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f040c1930 0x7f9f04157870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f02d9d700 1 -- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f040c1d00 msgr2=0x7f9f040cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f02d9d700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f040c1d00 0x7f9f040cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f02d9d700 1 -- 172.21.15.151:0/1346605707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4009370 con 0x7f9f040c5a00 2022-03-15T05:50:17.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f01d9b700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f040c1d00 0x7f9f040cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:17.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.320+0000 7f9f02d9d700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c5a00 0x7f9f04146ee0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c7c0 tx=0x7f9efc0015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:17.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.321+0000 7f9ef27fc700 1 -- 172.21.15.151:0/1346605707 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc005c70 con 0x7f9f040c5a00 2022-03-15T05:50:17.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.321+0000 7f9ef27fc700 1 -- 172.21.15.151:0/1346605707 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc005dd0 con 0x7f9f040c5a00 2022-03-15T05:50:17.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.321+0000 7f9ef27fc700 1 -- 172.21.15.151:0/1346605707 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0072e0 con 0x7f9f040c5a00 2022-03-15T05:50:17.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.321+0000 7f9f0359e700 1 -- 172.21.15.151:0/1346605707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f041573e0 con 0x7f9f040c5a00 2022-03-15T05:50:17.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.321+0000 7f9f0359e700 1 -- 172.21.15.151:0/1346605707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f041532c0 con 0x7f9f040c5a00 2022-03-15T05:50:17.335 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.322+0000 7f9f0359e700 1 -- 172.21.15.151:0/1346605707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f04157570 con 0x7f9f040c5a00 2022-03-15T05:50:17.335 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.322+0000 7f9ef27fc700 1 -- 172.21.15.151:0/1346605707 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f9efc019030 con 0x7f9f040c5a00 2022-03-15T05:50:17.335 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.323+0000 7f9ef27fc700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ee00633c0 0x7f9ee0065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.335 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.323+0000 7f9ef27fc700 1 -- 172.21.15.151:0/1346605707 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9efc07f080 con 0x7f9f040c5a00 2022-03-15T05:50:17.336 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.324+0000 7f9f0259c700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ee00633c0 0x7f9ee0065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.336 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.324+0000 7f9f0259c700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ee00633c0 0x7f9ee0065870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9f04089100 tx=0x7f9ef4016000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:17.336 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.327+0000 7f9ef27fc700 1 -- 172.21.15.151:0/1346605707 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f9efc048ac0 con 0x7f9f040c5a00 2022-03-15T05:50:17.509 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.508+0000 7f9f0359e700 1 -- 172.21.15.151:0/1346605707 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9f0404af20 con 0x7f9f040c5a00 2022-03-15T05:50:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.508+0000 7f9ef27fc700 1 -- 172.21.15.151:0/1346605707 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9efc017020 con 0x7f9f040c5a00 2022-03-15T05:50:17.511 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2022-03-15T05:50:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 -- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ee00633c0 msgr2=0x7f9ee0065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ee00633c0 0x7f9ee0065870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f9f04089100 tx=0x7f9ef4016000 comp rx=0 tx=0).stop 2022-03-15T05:50:17.513 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 -- 172.21.15.151:0/1346605707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c5a00 msgr2=0x7f9f04146ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c5a00 0x7f9f04146ee0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c7c0 tx=0x7f9efc0015e0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 -- 172.21.15.151:0/1346605707 shutdown_connections 2022-03-15T05:50:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9ee00633c0 0x7f9ee0065870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.514 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f040c5a00 0x7f9f04146ee0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9f040c1930 0x7f9f04157870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 --2- 172.21.15.151:0/1346605707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9f040c1d00 0x7f9f040cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 -- 172.21.15.151:0/1346605707 >> 172.21.15.151:0/1346605707 conn(0x7f9f04062490 msgr2=0x7f9f0414c490 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:17.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 -- 172.21.15.151:0/1346605707 shutdown_connections 2022-03-15T05:50:17.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.511+0000 7f9f0359e700 1 -- 172.21.15.151:0/1346605707 wait complete. 2022-03-15T05:50:17.538 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2022-03-15T05:50:17.756 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.753+0000 7f5f59ff9700 1 Processor -- start 2022-03-15T05:50:17.756 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.754+0000 7f5f59ff9700 1 -- start start 2022-03-15T05:50:17.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.755+0000 7f5f59ff9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5406cd70 0x7f5f5414e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.755+0000 7f5f59ff9700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f540c1500 con 0x7f5f54066b40 2022-03-15T05:50:17.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.755+0000 7f5f59ff9700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f5406d560 con 0x7f5f54067ab0 2022-03-15T05:50:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.755+0000 7f5f59ff9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5406e970 con 0x7f5f5406cd70 2022-03-15T05:50:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.755+0000 7f5f537fe700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f5f54066b40 0x7f5f5406d9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53232/0 (socket says 172.21.15.151:53232) 2022-03-15T05:50:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.755+0000 7f5f52ffd700 1 --2- 172.21.15.151:0/4232389198 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5406cd70 0x7f5f5414e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.755+0000 7f5f537fe700 1 -- 172.21.15.151:0/4232389198 learned_addr learned my addr 172.21.15.151:0/4232389198 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:17.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.756+0000 7f5f527fc700 1 -- 172.21.15.151:0/4232389198 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3674606850 0 0) 0x7f5f5406d560 con 0x7f5f54067ab0 2022-03-15T05:50:17.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.756+0000 7f5f527fc700 1 -- 172.21.15.151:0/4232389198 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f400033f0 con 0x7f5f54067ab0 2022-03-15T05:50:17.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.756+0000 7f5f527fc700 1 -- 172.21.15.151:0/4232389198 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2770774441 0 0) 0x7f5f540c1500 con 0x7f5f54066b40 2022-03-15T05:50:17.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.756+0000 7f5f52ffd700 1 -- 172.21.15.151:0/4232389198 >> v1:172.21.15.164:6789/0 conn(0x7f5f54067ab0 legacy=0x7f5f5415bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.756+0000 7f5f52ffd700 1 -- 172.21.15.151:0/4232389198 >> v1:172.21.15.151:6789/0 conn(0x7f5f54066b40 legacy=0x7f5f5406d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.756+0000 7f5f52ffd700 1 -- 172.21.15.151:0/4232389198 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f541513b0 con 0x7f5f5406cd70 2022-03-15T05:50:17.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.756+0000 7f5f52ffd700 1 --2- 172.21.15.151:0/4232389198 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5406cd70 0x7f5f5414e560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009790 tx=0x7f5f48009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b0f0eff8708785b server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:17.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.756+0000 7f5f527fc700 1 -- 172.21.15.151:0/4232389198 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48010600 con 0x7f5f5406cd70 2022-03-15T05:50:17.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.756+0000 7f5f527fc700 1 -- 172.21.15.151:0/4232389198 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f48010760 con 0x7f5f5406cd70 2022-03-15T05:50:17.763 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.756+0000 7f5f527fc700 1 -- 172.21.15.151:0/4232389198 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48010ae0 con 0x7f5f5406cd70 2022-03-15T05:50:17.763 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.757+0000 7f5f59ff9700 1 -- 172.21.15.151:0/4232389198 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5406cd70 msgr2=0x7f5f5414e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.763 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.757+0000 7f5f59ff9700 1 --2- 172.21.15.151:0/4232389198 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5406cd70 0x7f5f5414e560 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5f48009790 tx=0x7f5f48009060 comp rx=0 tx=0).stop 2022-03-15T05:50:17.763 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.757+0000 7f5f59ff9700 1 -- 172.21.15.151:0/4232389198 shutdown_connections 2022-03-15T05:50:17.764 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.757+0000 7f5f59ff9700 1 --2- 172.21.15.151:0/4232389198 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f5406cd70 0x7f5f5414e560 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.764 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.757+0000 7f5f59ff9700 1 -- 172.21.15.151:0/4232389198 >> 172.21.15.151:0/4232389198 conn(0x7f5f5406aa60 msgr2=0x7f5f540c6c30 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:17.764 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.757+0000 7f5f59ff9700 1 -- 172.21.15.151:0/4232389198 shutdown_connections 2022-03-15T05:50:17.764 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.757+0000 7f5f59ff9700 1 -- 172.21.15.151:0/4232389198 wait complete. 2022-03-15T05:50:17.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.759+0000 7f5f59ff9700 1 Processor -- start 2022-03-15T05:50:17.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.760+0000 7f5f59ff9700 1 -- start start 2022-03-15T05:50:17.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f59ff9700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f54066b40 0x7f5f54165230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f59ff9700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f54067ab0 0x7f5f541483a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f59ff9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5406cd70 0x7f5f540c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f59ff9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54157e50 con 0x7f5f5406cd70 2022-03-15T05:50:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f59ff9700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54157330 con 0x7f5f54066b40 2022-03-15T05:50:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f59ff9700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f54165770 con 0x7f5f54067ab0 2022-03-15T05:50:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f537fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f54066b40 0x7f5f54165230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f52ffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f54067ab0 0x7f5f541483a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f537fe700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f54066b40 0x7f5f54165230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57346/0 (socket says 172.21.15.151:57346) 2022-03-15T05:50:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f52ffd700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f54067ab0 0x7f5f541483a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60250/0 (socket says 172.21.15.151:60250) 2022-03-15T05:50:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.761+0000 7f5f537fe700 1 -- 172.21.15.151:0/2883538646 learned_addr learned my addr 172.21.15.151:0/2883538646 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f53fff700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5406cd70 0x7f5f540c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f52ffd700 1 -- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f54066b40 msgr2=0x7f5f54165230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f52ffd700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f54066b40 0x7f5f54165230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f52ffd700 1 -- 172.21.15.151:0/2883538646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5406cd70 msgr2=0x7f5f540c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f52ffd700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5406cd70 0x7f5f540c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f52ffd700 1 -- 172.21.15.151:0/2883538646 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480092a0 con 0x7f5f54067ab0 2022-03-15T05:50:17.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f53fff700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5406cd70 0x7f5f540c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:50:17.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f52ffd700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f54067ab0 0x7f5f541483a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f48017000 tx=0x7f5f48018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:17.772 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f3b7fe700 1 -- 172.21.15.151:0/2883538646 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480036f0 con 0x7f5f54067ab0 2022-03-15T05:50:17.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f3b7fe700 1 -- 172.21.15.151:0/2883538646 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f4801d040 con 0x7f5f54067ab0 2022-03-15T05:50:17.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f59ff9700 1 -- 172.21.15.151:0/2883538646 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f541488e0 con 0x7f5f54067ab0 2022-03-15T05:50:17.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.762+0000 7f5f3b7fe700 1 -- 172.21.15.151:0/2883538646 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f48003b00 con 0x7f5f54067ab0 2022-03-15T05:50:17.773 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.763+0000 7f5f59ff9700 1 -- 172.21.15.151:0/2883538646 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f54158380 con 0x7f5f54067ab0 2022-03-15T05:50:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.764+0000 7f5f59ff9700 1 -- 172.21.15.151:0/2883538646 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f5404b760 con 0x7f5f54067ab0 2022-03-15T05:50:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.764+0000 7f5f3b7fe700 1 -- 172.21.15.151:0/2883538646 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f5f48028030 con 0x7f5f54067ab0 2022-03-15T05:50:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.765+0000 7f5f3b7fe700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5f340633c0 0x7f5f34065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:17.774 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.765+0000 7f5f3b7fe700 1 -- 172.21.15.151:0/2883538646 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5f48080bf0 con 0x7f5f54067ab0 2022-03-15T05:50:17.775 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.766+0000 7f5f537fe700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5f340633c0 0x7f5f34065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:17.775 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.766+0000 7f5f537fe700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5f340633c0 0x7f5f34065870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f44007fd0 tx=0x7f5f44007c70 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:17.776 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.770+0000 7f5f3b7fe700 1 -- 172.21.15.151:0/2883538646 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f5f4804fb90 con 0x7f5f54067ab0 2022-03-15T05:50:17.953 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.951+0000 7f5f59ff9700 1 -- 172.21.15.151:0/2883538646 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f54151650 con 0x7f5f54067ab0 2022-03-15T05:50:17.954 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.952+0000 7f5f3b7fe700 1 -- 172.21.15.151:0/2883538646 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f480260a0 con 0x7f5f54067ab0 2022-03-15T05:50:17.955 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2022-03-15T05:50:17.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.954+0000 7f5f59ff9700 1 -- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5f340633c0 msgr2=0x7f5f34065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.957 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.954+0000 7f5f59ff9700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5f340633c0 0x7f5f34065870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5f44007fd0 tx=0x7f5f44007c70 comp rx=0 tx=0).stop 2022-03-15T05:50:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.955+0000 7f5f59ff9700 1 -- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f54067ab0 msgr2=0x7f5f541483a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.955+0000 7f5f59ff9700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f54067ab0 0x7f5f541483a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5f48017000 tx=0x7f5f48018000 comp rx=0 tx=0).stop 2022-03-15T05:50:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.955+0000 7f5f59ff9700 1 -- 172.21.15.151:0/2883538646 shutdown_connections 2022-03-15T05:50:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.955+0000 7f5f59ff9700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f5f340633c0 0x7f5f34065870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.958 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.955+0000 7f5f59ff9700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f5406cd70 0x7f5f540c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.955+0000 7f5f59ff9700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5f54066b40 0x7f5f54165230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.955+0000 7f5f59ff9700 1 --2- 172.21.15.151:0/2883538646 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f5f54067ab0 0x7f5f541483a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:17.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.955+0000 7f5f59ff9700 1 -- 172.21.15.151:0/2883538646 >> 172.21.15.151:0/2883538646 conn(0x7f5f5406aa60 msgr2=0x7f5f5414e330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:17.959 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.955+0000 7f5f59ff9700 1 -- 172.21.15.151:0/2883538646 shutdown_connections 2022-03-15T05:50:17.960 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:17.955+0000 7f5f59ff9700 1 -- 172.21.15.151:0/2883538646 wait complete. 2022-03-15T05:50:17.981 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-03-15T05:50:18.188 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.186+0000 7ff3a688b700 1 Processor -- start 2022-03-15T05:50:18.189 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.187+0000 7ff3a688b700 1 -- start start 2022-03-15T05:50:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.188+0000 7ff3a688b700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7ff3a00c3d70 0x7ff3a0067b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:18.190 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.188+0000 7ff3a688b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.188+0000 7ff3a688b700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3a0068060 con 0x7ff3a006e6d0 2022-03-15T05:50:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.188+0000 7ff3a688b700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3a0066d50 con 0x7ff3a00c3d70 2022-03-15T05:50:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.188+0000 7ff3a688b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a00678f0 con 0x7ff3a006eaa0 2022-03-15T05:50:18.191 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.188+0000 7ff39ffff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff3a006e6d0 0x7ff3a00671e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53234/0 (socket says 172.21.15.151:53234) 2022-03-15T05:50:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.188+0000 7ff39ffff700 1 -- 172.21.15.151:0/4023946917 learned_addr learned my addr 172.21.15.151:0/4023946917 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.188+0000 7ff3a4e28700 1 --2- 172.21.15.151:0/4023946917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:18.192 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.188+0000 7ff39f7fe700 1 --2- 172.21.15.151:0/4023946917 >> v2:172.21.15.164:3300/0 conn(0x7ff3a00c3d70 0x7ff3a0067b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:18.196 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.189+0000 7ff3a4e28700 1 -- 172.21.15.151:0/4023946917 >> v2:172.21.15.164:3300/0 conn(0x7ff3a00c3d70 msgr2=0x7ff3a0067b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:18.197 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.189+0000 7ff3a4e28700 1 --2- 172.21.15.151:0/4023946917 >> v2:172.21.15.164:3300/0 conn(0x7ff3a00c3d70 0x7ff3a0067b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:18.197 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.189+0000 7ff39effd700 1 -- 172.21.15.151:0/4023946917 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347617430 0 0) 0x7ff390001110 con 0x7ff3a006e6d0 2022-03-15T05:50:18.197 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.189+0000 7ff3a4e28700 1 -- 172.21.15.151:0/4023946917 >> v1:172.21.15.151:6789/0 conn(0x7ff3a006e6d0 legacy=0x7ff3a00671e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:18.198 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.189+0000 7ff3a4e28700 1 -- 172.21.15.151:0/4023946917 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a0066a20 con 0x7ff3a006eaa0 2022-03-15T05:50:18.198 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.189+0000 7ff3a4e28700 1 --2- 172.21.15.151:0/4023946917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c05f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff398009e60 tx=0x7ff398009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d00c586674d16706 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:18.198 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.189+0000 7ff39effd700 1 -- 172.21.15.151:0/4023946917 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39800e070 con 0x7ff3a006eaa0 2022-03-15T05:50:18.198 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.189+0000 7ff39effd700 1 -- 172.21.15.151:0/4023946917 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff39800bb60 con 0x7ff3a006eaa0 2022-03-15T05:50:18.199 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.189+0000 7ff39effd700 1 -- 172.21.15.151:0/4023946917 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff398012430 con 0x7ff3a006eaa0 2022-03-15T05:50:18.199 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.190+0000 7ff3a688b700 1 -- 172.21.15.151:0/4023946917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 msgr2=0x7ff3a00c05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:18.199 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.190+0000 7ff3a688b700 1 --2- 172.21.15.151:0/4023946917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c05f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff398009e60 tx=0x7ff398009780 comp rx=0 tx=0).stop 2022-03-15T05:50:18.199 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.190+0000 7ff3a688b700 1 -- 172.21.15.151:0/4023946917 shutdown_connections 2022-03-15T05:50:18.200 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.190+0000 7ff3a688b700 1 --2- 172.21.15.151:0/4023946917 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c05f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:18.200 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.190+0000 7ff3a688b700 1 --2- 172.21.15.151:0/4023946917 >> v2:172.21.15.164:3300/0 conn(0x7ff3a00c3d70 0x7ff3a0067b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:18.200 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.190+0000 7ff3a688b700 1 -- 172.21.15.151:0/4023946917 >> 172.21.15.151:0/4023946917 conn(0x7ff3a00c75c0 msgr2=0x7ff3a00c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:18.200 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.190+0000 7ff3a688b700 1 -- 172.21.15.151:0/4023946917 shutdown_connections 2022-03-15T05:50:18.201 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.190+0000 7ff3a688b700 1 -- 172.21.15.151:0/4023946917 wait complete. 2022-03-15T05:50:18.201 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.192+0000 7ff3a688b700 1 Processor -- start 2022-03-15T05:50:18.201 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.192+0000 7ff3a688b700 1 -- start start 2022-03-15T05:50:18.201 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff3a688b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3a006e6d0 0x7ff3a0150e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:18.202 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff3a688b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c1ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:18.202 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff3a688b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3a00c3d70 0x7ff3a015a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:18.202 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff3a688b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a0157960 con 0x7ff3a006e6d0 2022-03-15T05:50:18.202 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff3a688b700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01583e0 con 0x7ff3a00c3d70 2022-03-15T05:50:18.203 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff3a688b700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a01560a0 con 0x7ff3a006eaa0 2022-03-15T05:50:18.203 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3a006e6d0 0x7ff3a0150e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:18.203 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39f7fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c1ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:18.203 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff3a4e28700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3a00c3d70 0x7ff3a015a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:18.203 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3a006e6d0 0x7ff3a0150e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60138/0 (socket says 172.21.15.151:60138) 2022-03-15T05:50:18.204 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39f7fe700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c1ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60254/0 (socket says 172.21.15.151:60254) 2022-03-15T05:50:18.204 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39ffff700 1 -- 172.21.15.151:0/3014717181 learned_addr learned my addr 172.21.15.151:0/3014717181 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:18.204 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39f7fe700 1 -- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3a00c3d70 msgr2=0x7ff3a015a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:18.204 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39f7fe700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3a00c3d70 0x7ff3a015a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:18.205 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39f7fe700 1 -- 172.21.15.151:0/3014717181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3a006e6d0 msgr2=0x7ff3a0150e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:18.205 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39f7fe700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3a006e6d0 0x7ff3a0150e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:18.205 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39f7fe700 1 -- 172.21.15.151:0/3014717181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff398009a20 con 0x7ff3a006eaa0 2022-03-15T05:50:18.205 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.193+0000 7ff39ffff700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3a006e6d0 0x7ff3a0150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:18.206 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.194+0000 7ff39f7fe700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c1ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff39400e900 tx=0x7ff394009060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:18.206 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.194+0000 7ff387fff700 1 -- 172.21.15.151:0/3014717181 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394013680 con 0x7ff3a006eaa0 2022-03-15T05:50:18.206 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.194+0000 7ff387fff700 1 -- 172.21.15.151:0/3014717181 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3940137e0 con 0x7ff3a006eaa0 2022-03-15T05:50:18.206 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.194+0000 7ff3a688b700 1 -- 172.21.15.151:0/3014717181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a0156360 con 0x7ff3a006eaa0 2022-03-15T05:50:18.206 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.194+0000 7ff387fff700 1 -- 172.21.15.151:0/3014717181 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394013b80 con 0x7ff3a006eaa0 2022-03-15T05:50:18.207 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.194+0000 7ff3a688b700 1 -- 172.21.15.151:0/3014717181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a0156920 con 0x7ff3a006eaa0 2022-03-15T05:50:18.208 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.195+0000 7ff3a688b700 1 -- 172.21.15.151:0/3014717181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3a004b760 con 0x7ff3a006eaa0 2022-03-15T05:50:18.208 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.196+0000 7ff387fff700 1 -- 172.21.15.151:0/3014717181 <== mon.2 v2:172.21.15.164:3301/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7ff394019030 con 0x7ff3a006eaa0 2022-03-15T05:50:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.197+0000 7ff387fff700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff3800633f0 0x7ff3800658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.197+0000 7ff387fff700 1 -- 172.21.15.151:0/3014717181 <== mon.2 v2:172.21.15.164:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff39407ff20 con 0x7ff3a006eaa0 2022-03-15T05:50:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.197+0000 7ff39ffff700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff3800633f0 0x7ff3800658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:18.209 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.198+0000 7ff39ffff700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff3800633f0 0x7ff3800658a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff390007fd0 tx=0x7ff390007d90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:18.210 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.200+0000 7ff387fff700 1 -- 172.21.15.151:0/3014717181 <== mon.2 v2:172.21.15.164:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7ff39404efb0 con 0x7ff3a006eaa0 2022-03-15T05:50:18.428 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.426+0000 7ff3a688b700 1 -- 172.21.15.151:0/3014717181 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3a0152dc0 con 0x7ff3a006eaa0 2022-03-15T05:50:18.429 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.427+0000 7ff387fff700 1 -- 172.21.15.151:0/3014717181 <== mon.2 v2:172.21.15.164:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+6152 (secure 0 0 0) 0x7ff394021090 con 0x7ff3a006eaa0 2022-03-15T05:50:18.429 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:18.430 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1733346300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1733346300},{"type":"v1","addr":"172.21.15.164:6836","nonce":1733346300}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2036596705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6837","nonce":2036596705},{"type":"v1","addr":"172.21.15.164:6839","nonce":2036596705}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3829445475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3829445475},{"type":"v1","addr":"172.21.15.151:6834","nonce":3829445475}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-03-15T05:50:02.249169+0000","modified":"2022-03-15T05:50:12.725528+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4312,"mds_1":4300,"mds_2":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"e","rank":2,"incarnation":11,"state":"up:creating","state_seq":1,"addr":"172.21.15.151:6837/745076217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":745076217},{"type":"v1","addr":"172.21.15.151:6837","nonce":745076217}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.164:6838/4178735378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":4178735378},{"type":"v1","addr":"172.21.15.164:6838","nonce":4178735378}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4312":{"gid":4312,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/3891906240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3891906240},{"type":"v1","addr":"172.21.15.151:6835","nonce":3891906240}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-03-15T05:50:18.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.429+0000 7ff3a688b700 1 -- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff3800633f0 msgr2=0x7ff3800658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:18.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.429+0000 7ff3a688b700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff3800633f0 0x7ff3800658a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff390007fd0 tx=0x7ff390007d90 comp rx=0 tx=0).stop 2022-03-15T05:50:18.432 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.429+0000 7ff3a688b700 1 -- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 msgr2=0x7ff3a00c1ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:18.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.429+0000 7ff3a688b700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c1ac0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff39400e900 tx=0x7ff394009060 comp rx=0 tx=0).stop 2022-03-15T05:50:18.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.429+0000 7ff3a688b700 1 -- 172.21.15.151:0/3014717181 shutdown_connections 2022-03-15T05:50:18.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.430+0000 7ff3a688b700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7ff3800633f0 0x7ff3800658a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:18.433 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.430+0000 7ff3a688b700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff3a00c3d70 0x7ff3a015a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:18.434 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.430+0000 7ff3a688b700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3a006e6d0 0x7ff3a0150e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:18.434 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.430+0000 7ff3a688b700 1 --2- 172.21.15.151:0/3014717181 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7ff3a006eaa0 0x7ff3a00c1ac0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:18.434 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.430+0000 7ff3a688b700 1 -- 172.21.15.151:0/3014717181 >> 172.21.15.151:0/3014717181 conn(0x7ff3a00c75c0 msgr2=0x7ff3a00bdec0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:18.434 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.430+0000 7ff3a688b700 1 -- 172.21.15.151:0/3014717181 shutdown_connections 2022-03-15T05:50:18.435 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:18.430+0000 7ff3a688b700 1 -- 172.21.15.151:0/3014717181 wait complete. 2022-03-15T05:50:18.435 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 11 2022-03-15T05:50:19.060 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-03-15T05:50:02.249169+0000', 'modified': '2022-03-15T05:50:12.725528+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4312, 'mds_1': 4300, 'mds_2': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'e', 'rank': 2, 'incarnation': 11, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.151:6837/745076217', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 745076217}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 745076217}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4300': {'gid': 4300, 'name': 'd', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.164:6838/4178735378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6835', 'nonce': 4178735378}, {'type': 'v1', 'addr': '172.21.15.164:6838', 'nonce': 4178735378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4312': {'gid': 4312, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.151:6835/3891906240', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6833', 'nonce': 3891906240}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 3891906240}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-03-15T05:50:19.061 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4284:up:creating 2022-03-15T05:50:20.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2022-03-15T05:50:20.277 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.275+0000 7f4debbaf700 1 Processor -- start 2022-03-15T05:50:20.278 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.275+0000 7f4debbaf700 1 -- start start 2022-03-15T05:50:20.279 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.276+0000 7f4debbaf700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4de4155120 0x7f4de4155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:20.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4debbaf700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de40c1cc0 con 0x7f4de40c2150 2022-03-15T05:50:20.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4debbaf700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4de40c33e0 con 0x7f4de4154d50 2022-03-15T05:50:20.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4debbaf700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4de40c4060 con 0x7f4de4155120 2022-03-15T05:50:20.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4de914a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f4de4155120 0x7f4de4155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:20.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4de994b700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f4de4154d50 0x7f4de4067a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33692/0 (socket says 172.21.15.151:33692) 2022-03-15T05:50:20.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4dea14c700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f4de40c2150 0x7f4de40c2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53236/0 (socket says 172.21.15.151:53236) 2022-03-15T05:50:20.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4de994b700 1 -- 172.21.15.151:0/1734015417 learned_addr learned my addr 172.21.15.151:0/1734015417 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:20.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4de8949700 1 -- 172.21.15.151:0/1734015417 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162102109 0 0) 0x7f4de40c33e0 con 0x7f4de4154d50 2022-03-15T05:50:20.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4de8949700 1 -- 172.21.15.151:0/1734015417 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4dcc0033f0 con 0x7f4de4154d50 2022-03-15T05:50:20.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4de914a700 1 -- 172.21.15.151:0/1734015417 >> v1:172.21.15.164:6789/0 conn(0x7f4de4154d50 legacy=0x7f4de4067a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:20.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4de914a700 1 -- 172.21.15.151:0/1734015417 >> v1:172.21.15.151:6789/0 conn(0x7f4de40c2150 legacy=0x7f4de40c2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:20.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.277+0000 7f4de914a700 1 -- 172.21.15.151:0/1734015417 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4de40c4340 con 0x7f4de4155120 2022-03-15T05:50:20.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.278+0000 7f4de914a700 1 --2- 172.21.15.151:0/1734015417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de4155120 0x7f4de4155570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009760 tx=0x7f4dd4009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c98f8d3db8c8ab84 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:20.286 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.278+0000 7f4de8949700 1 -- 172.21.15.151:0/1734015417 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011630 con 0x7f4de4155120 2022-03-15T05:50:20.286 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.278+0000 7f4de8949700 1 -- 172.21.15.151:0/1734015417 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dd4011790 con 0x7f4de4155120 2022-03-15T05:50:20.287 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.278+0000 7f4de8949700 1 -- 172.21.15.151:0/1734015417 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dd4011b30 con 0x7f4de4155120 2022-03-15T05:50:20.287 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.279+0000 7f4debbaf700 1 -- 172.21.15.151:0/1734015417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de4155120 msgr2=0x7f4de4155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:20.287 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.279+0000 7f4debbaf700 1 --2- 172.21.15.151:0/1734015417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de4155120 0x7f4de4155570 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4dd4009760 tx=0x7f4dd4009060 comp rx=0 tx=0).stop 2022-03-15T05:50:20.287 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.279+0000 7f4debbaf700 1 -- 172.21.15.151:0/1734015417 shutdown_connections 2022-03-15T05:50:20.287 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.279+0000 7f4debbaf700 1 --2- 172.21.15.151:0/1734015417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de4155120 0x7f4de4155570 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:20.288 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.279+0000 7f4debbaf700 1 -- 172.21.15.151:0/1734015417 >> 172.21.15.151:0/1734015417 conn(0x7f4de40c75c0 msgr2=0x7f4de40c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:20.288 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.279+0000 7f4debbaf700 1 -- 172.21.15.151:0/1734015417 shutdown_connections 2022-03-15T05:50:20.288 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.279+0000 7f4debbaf700 1 -- 172.21.15.151:0/1734015417 wait complete. 2022-03-15T05:50:20.288 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.280+0000 7f4debbaf700 1 Processor -- start 2022-03-15T05:50:20.289 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.281+0000 7f4debbaf700 1 -- start start 2022-03-15T05:50:20.289 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.281+0000 7f4debbaf700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de40c2150 0x7f4de406c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:20.289 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4debbaf700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de4154d50 0x7f4de4151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:20.289 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4debbaf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4155120 0x7f4de4066b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:20.290 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4debbaf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de414f150 con 0x7f4de4155120 2022-03-15T05:50:20.290 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4debbaf700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4de4150e20 con 0x7f4de4154d50 2022-03-15T05:50:20.290 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4debbaf700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4de414ee70 con 0x7f4de40c2150 2022-03-15T05:50:20.290 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4dea14c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4155120 0x7f4de4066b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:20.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4de994b700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de40c2150 0x7f4de406c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:20.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4de914a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de4154d50 0x7f4de4151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:20.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4dea14c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4155120 0x7f4de4066b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60140/0 (socket says 172.21.15.151:60140) 2022-03-15T05:50:20.291 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4dea14c700 1 -- 172.21.15.151:0/1115317249 learned_addr learned my addr 172.21.15.151:0/1115317249 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:20.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4de994b700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de40c2150 0x7f4de406c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60256/0 (socket says 172.21.15.151:60256) 2022-03-15T05:50:20.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4dea14c700 1 -- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de40c2150 msgr2=0x7f4de406c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:20.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4dea14c700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de40c2150 0x7f4de406c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:20.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4dea14c700 1 -- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de4154d50 msgr2=0x7f4de4151ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:20.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4dea14c700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de4154d50 0x7f4de4151ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:20.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4dea14c700 1 -- 172.21.15.151:0/1115317249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dd40092a0 con 0x7f4de4155120 2022-03-15T05:50:20.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.282+0000 7f4de914a700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de4154d50 0x7f4de4151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:20.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.283+0000 7f4dea14c700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4155120 0x7f4de4066b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c790 tx=0x7f4ddc0015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:20.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.283+0000 7f4dd1ffb700 1 -- 172.21.15.151:0/1115317249 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc005c70 con 0x7f4de4155120 2022-03-15T05:50:20.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.283+0000 7f4dd1ffb700 1 -- 172.21.15.151:0/1115317249 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ddc005dd0 con 0x7f4de4155120 2022-03-15T05:50:20.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.283+0000 7f4dd1ffb700 1 -- 172.21.15.151:0/1115317249 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc007300 con 0x7f4de4155120 2022-03-15T05:50:20.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.283+0000 7f4debbaf700 1 -- 172.21.15.151:0/1115317249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4de41510c0 con 0x7f4de4155120 2022-03-15T05:50:20.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.283+0000 7f4debbaf700 1 -- 172.21.15.151:0/1115317249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4de4151680 con 0x7f4de4155120 2022-03-15T05:50:20.295 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.284+0000 7f4debbaf700 1 -- 172.21.15.151:0/1115317249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de404b760 con 0x7f4de4155120 2022-03-15T05:50:20.296 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.285+0000 7f4dd1ffb700 1 -- 172.21.15.151:0/1115317249 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f4ddc010070 con 0x7f4de4155120 2022-03-15T05:50:20.296 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.286+0000 7f4dd1ffb700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633f0 0x7f4dc40658a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:20.296 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.286+0000 7f4dd1ffb700 1 -- 172.21.15.151:0/1115317249 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4ddc07f6d0 con 0x7f4de4155120 2022-03-15T05:50:20.296 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.286+0000 7f4de994b700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633f0 0x7f4dc40658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:20.297 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.287+0000 7f4de994b700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633f0 0x7f4dc40658a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4de0005750 tx=0x7f4de0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:20.297 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.290+0000 7f4dd1ffb700 1 -- 172.21.15.151:0/1115317249 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f4ddc04e780 con 0x7f4de4155120 2022-03-15T05:50:20.511 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.510+0000 7f4debbaf700 1 -- 172.21.15.151:0/1115317249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4de40c1670 con 0x7f4de4155120 2022-03-15T05:50:20.512 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.510+0000 7f4dd1ffb700 1 -- 172.21.15.151:0/1115317249 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+6150 (secure 0 0 0) 0x7f4ddc051da0 con 0x7f4de4155120 2022-03-15T05:50:20.513 INFO:teuthology.orchestra.run.smithi151.stdout: 2022-03-15T05:50:20.513 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6836/1733346300","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":1733346300},{"type":"v1","addr":"172.21.15.164:6836","nonce":1733346300}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4250,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2036596705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6837","nonce":2036596705},{"type":"v1","addr":"172.21.15.164:6839","nonce":2036596705}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6834/3829445475","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3829445475},{"type":"v1","addr":"172.21.15.151:6834","nonce":3829445475}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2022-03-15T05:50:02.249169+0000","modified":"2022-03-15T05:50:18.704655+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4312,"mds_1":4300,"mds_2":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"e","rank":2,"incarnation":11,"state":"up:active","state_seq":7,"addr":"172.21.15.151:6837/745076217","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":745076217},{"type":"v1","addr":"172.21.15.151:6837","nonce":745076217}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4300":{"gid":4300,"name":"d","rank":1,"incarnation":9,"state":"up:active","state_seq":6,"addr":"172.21.15.164:6838/4178735378","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6835","nonce":4178735378},{"type":"v1","addr":"172.21.15.164:6838","nonce":4178735378}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_4312":{"gid":4312,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.151:6835/3891906240","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6833","nonce":3891906240},{"type":"v1","addr":"172.21.15.151:6835","nonce":3891906240}]},"join_fscid":-1,"export_targets":[],"features":4540138303579357183,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2022-03-15T05:50:20.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 -- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633f0 msgr2=0x7f4dc40658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:20.515 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633f0 0x7f4dc40658a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4de0005750 tx=0x7f4de0009040 comp rx=0 tx=0).stop 2022-03-15T05:50:20.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 -- 172.21.15.151:0/1115317249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4155120 msgr2=0x7f4de4066b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:20.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4155120 0x7f4de4066b40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c790 tx=0x7f4ddc0015e0 comp rx=0 tx=0).stop 2022-03-15T05:50:20.516 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 -- 172.21.15.151:0/1115317249 shutdown_connections 2022-03-15T05:50:20.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f4dc40633f0 0x7f4dc40658a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:20.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4155120 0x7f4de4066b40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:20.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f4de40c2150 0x7f4de406c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:20.517 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 --2- 172.21.15.151:0/1115317249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4de4154d50 0x7f4de4151ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:20.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 -- 172.21.15.151:0/1115317249 >> 172.21.15.151:0/1115317249 conn(0x7f4de40c75c0 msgr2=0x7f4de40c57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:20.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 -- 172.21.15.151:0/1115317249 shutdown_connections 2022-03-15T05:50:20.518 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:20.513+0000 7f4debbaf700 1 -- 172.21.15.151:0/1115317249 wait complete. 2022-03-15T05:50:20.519 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 12 2022-03-15T05:50:21.142 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2022-03-15T05:50:02.249169+0000', 'modified': '2022-03-15T05:50:18.704655+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4312, 'mds_1': 4300, 'mds_2': 4284}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4284': {'gid': 4284, 'name': 'e', 'rank': 2, 'incarnation': 11, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.151:6837/745076217', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 745076217}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 745076217}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4300': {'gid': 4300, 'name': 'd', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.164:6838/4178735378', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.164:6835', 'nonce': 4178735378}, {'type': 'v1', 'addr': '172.21.15.164:6838', 'nonce': 4178735378}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_4312': {'gid': 4312, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.151:6835/3891906240', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6833', 'nonce': 3891906240}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 3891906240}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138303579357183, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2022-03-15T05:50:21.143 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2022-03-15T05:50:21.143 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2022-03-15T05:50:21.351 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.349+0000 7f7503a93700 1 Processor -- start 2022-03-15T05:50:21.352 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.349+0000 7f7503a93700 1 -- start start 2022-03-15T05:50:21.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.350+0000 7f7503a93700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f74fc0cb5c0 0x7f74fc0c34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.351+0000 7f7503a93700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc0c27b0 con 0x7f74fc0cb1f0 2022-03-15T05:50:21.353 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.351+0000 7f7503a93700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc156170 con 0x7f74fc155cf0 2022-03-15T05:50:21.354 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.351+0000 7f7503a93700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc0c4f90 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.354 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.351+0000 7f750182f700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f74fc0cb1f0 0x7f74fc1566c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53238/0 (socket says 172.21.15.151:53238) 2022-03-15T05:50:21.354 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.351+0000 7f750182f700 1 -- 172.21.15.151:0/841971258 learned_addr learned my addr 172.21.15.151:0/841971258 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:21.355 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.351+0000 7f750102e700 1 --2- 172.21.15.151:0/841971258 >> v2:172.21.15.164:3300/0 conn(0x7f74fc0cb5c0 0x7f74fc0c34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.351+0000 7f750082d700 1 -- 172.21.15.151:0/841971258 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1996903688 0 0) 0x7f74fc156170 con 0x7f74fc155cf0 2022-03-15T05:50:21.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.352+0000 7f750082d700 1 -- 172.21.15.151:0/841971258 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e40033f0 con 0x7f74fc155cf0 2022-03-15T05:50:21.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.352+0000 7f750082d700 1 -- 172.21.15.151:0/841971258 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906448469 0 0) 0x7f74fc0c27b0 con 0x7f74fc0cb1f0 2022-03-15T05:50:21.357 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.352+0000 7f750102e700 1 -- 172.21.15.151:0/841971258 >> v1:172.21.15.164:6789/0 conn(0x7f74fc155cf0 legacy=0x7f74fc0c58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:21.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.352+0000 7f750102e700 1 -- 172.21.15.151:0/841971258 >> v1:172.21.15.151:6789/0 conn(0x7f74fc0cb1f0 legacy=0x7f74fc1566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:21.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.352+0000 7f750102e700 1 -- 172.21.15.151:0/841971258 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc0c5270 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.352+0000 7f750102e700 1 --2- 172.21.15.151:0/841971258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc0cb5c0 0x7f74fc0c34e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009760 tx=0x7f74ec009060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fa63e2f77e21369 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:21.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.352+0000 7f750082d700 1 -- 172.21.15.151:0/841971258 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec011630 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.358 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.352+0000 7f750082d700 1 -- 172.21.15.151:0/841971258 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec011790 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.352+0000 7f750082d700 1 -- 172.21.15.151:0/841971258 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec011b50 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.353+0000 7f7503a93700 1 -- 172.21.15.151:0/841971258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc0cb5c0 msgr2=0x7f74fc0c34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:21.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.353+0000 7f7503a93700 1 --2- 172.21.15.151:0/841971258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc0cb5c0 0x7f74fc0c34e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f74ec009760 tx=0x7f74ec009060 comp rx=0 tx=0).stop 2022-03-15T05:50:21.359 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.353+0000 7f7503a93700 1 -- 172.21.15.151:0/841971258 shutdown_connections 2022-03-15T05:50:21.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.353+0000 7f7503a93700 1 --2- 172.21.15.151:0/841971258 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc0cb5c0 0x7f74fc0c34e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.353+0000 7f7503a93700 1 -- 172.21.15.151:0/841971258 >> 172.21.15.151:0/841971258 conn(0x7f74fc068e90 msgr2=0x7f74fc069290 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:21.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.353+0000 7f7503a93700 1 -- 172.21.15.151:0/841971258 shutdown_connections 2022-03-15T05:50:21.360 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.353+0000 7f7503a93700 1 -- 172.21.15.151:0/841971258 wait complete. 2022-03-15T05:50:21.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.354+0000 7f7503a93700 1 Processor -- start 2022-03-15T05:50:21.361 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.355+0000 7f7503a93700 1 -- start start 2022-03-15T05:50:21.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.355+0000 7f7503a93700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74fc0cb1f0 0x7f74fc153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f7503a93700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cb5c0 0x7f74fc168220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.364 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f7503a93700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc155cf0 0x7f74fc1502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f7503a93700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc0a74e0 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f7503a93700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc1597b0 con 0x7f74fc155cf0 2022-03-15T05:50:21.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f7503a93700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc15a9c0 con 0x7f74fc0cb1f0 2022-03-15T05:50:21.365 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f750102e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cb5c0 0x7f74fc168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f750182f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74fc0cb1f0 0x7f74fc153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f750102e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cb5c0 0x7f74fc168220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60142/0 (socket says 172.21.15.151:60142) 2022-03-15T05:50:21.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f750102e700 1 -- 172.21.15.151:0/1985224353 learned_addr learned my addr 172.21.15.151:0/1985224353 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:21.366 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f7502030700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc155cf0 0x7f74fc1502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.367 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f750102e700 1 -- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74fc0cb1f0 msgr2=0x7f74fc153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:21.367 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f750102e700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74fc0cb1f0 0x7f74fc153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.367 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f750102e700 1 -- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc155cf0 msgr2=0x7f74fc1502b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:21.367 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f750102e700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc155cf0 0x7f74fc1502b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.367 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.356+0000 7f750102e700 1 -- 172.21.15.151:0/1985224353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec0092a0 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.357+0000 7f750102e700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cb5c0 0x7f74fc168220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0688a0 tx=0x7f74ec017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:21.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.357+0000 7f74e9ffb700 1 -- 172.21.15.151:0/1985224353 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec009130 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.357+0000 7f74e9ffb700 1 -- 172.21.15.151:0/1985224353 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec000bc0 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.368 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.357+0000 7f74e9ffb700 1 -- 172.21.15.151:0/1985224353 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec011b30 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.357+0000 7f7503a93700 1 -- 172.21.15.151:0/1985224353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74fc1599c0 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.357+0000 7f7503a93700 1 -- 172.21.15.151:0/1985224353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc159f80 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.359+0000 7f74e9ffb700 1 -- 172.21.15.151:0/1985224353 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f74ec00f050 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.360+0000 7f74e9ffb700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f74dc0633c0 0x7f74dc065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.369 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.360+0000 7f74e9ffb700 1 -- 172.21.15.151:0/1985224353 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74ec080f00 con 0x7f74fc0cb5c0 2022-03-15T05:50:21.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.360+0000 7f750182f700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f74dc0633c0 0x7f74dc065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.361+0000 7f750182f700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f74dc0633c0 0x7f74dc065870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f74f8007fd0 tx=0x7f74f8007d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:21.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.362+0000 7f750d40cb80 1 Processor -- start 2022-03-15T05:50:21.370 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.362+0000 7f750d40cb80 1 -- start start 2022-03-15T05:50:21.376 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c75bca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79cbd0 0x55a18c79b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c79baf0 0x55a18c791bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f750d40cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18c6da540 con 0x55a18c75b1c0 2022-03-15T05:50:21.377 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f750d40cb80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18c6488a0 con 0x55a18c79cbd0 2022-03-15T05:50:21.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f750d40cb80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a18c6b0ae0 con 0x55a18c79baf0 2022-03-15T05:50:21.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f750182f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c75bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f750182f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c75bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60144/0 (socket says 172.21.15.151:60144) 2022-03-15T05:50:21.378 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f750182f700 1 -- 172.21.15.151:0/1526801783 learned_addr learned my addr 172.21.15.151:0/1526801783 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:21.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f750102e700 1 --2- 172.21.15.151:0/1526801783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79cbd0 0x55a18c79b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.363+0000 7f7502030700 1 --2- 172.21.15.151:0/1526801783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c79baf0 0x55a18c791bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.364+0000 7f750102e700 1 -- 172.21.15.151:0/1526801783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c79baf0 msgr2=0x55a18c791bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:21.379 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.364+0000 7f750102e700 1 --2- 172.21.15.151:0/1526801783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c79baf0 0x55a18c791bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.364+0000 7f750102e700 1 -- 172.21.15.151:0/1526801783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 msgr2=0x55a18c75bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:21.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.364+0000 7f750102e700 1 --2- 172.21.15.151:0/1526801783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c75bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.364+0000 7f750102e700 1 -- 172.21.15.151:0/1526801783 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a18c5a0890 con 0x55a18c79cbd0 2022-03-15T05:50:21.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.364+0000 7f750182f700 1 --2- 172.21.15.151:0/1526801783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c75bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:21.380 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.364+0000 7f750102e700 1 --2- 172.21.15.151:0/1526801783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79cbd0 0x55a18c79b5b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74ec050150 tx=0x7f74ec000dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a19ab9b2e3c89e0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:21.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.364+0000 7f74daffd700 1 -- 172.21.15.151:0/1526801783 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec068030 con 0x55a18c79cbd0 2022-03-15T05:50:21.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.364+0000 7f74daffd700 1 -- 172.21.15.151:0/1526801783 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec0535b0 con 0x55a18c79cbd0 2022-03-15T05:50:21.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.364+0000 7f74daffd700 1 -- 172.21.15.151:0/1526801783 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec054280 con 0x55a18c79cbd0 2022-03-15T05:50:21.381 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.365+0000 7f750d40cb80 1 -- 172.21.15.151:0/1526801783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79cbd0 msgr2=0x55a18c79b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:21.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.365+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1526801783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79cbd0 0x55a18c79b5b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74ec050150 tx=0x7f74ec000dd0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.365+0000 7f750d40cb80 1 -- 172.21.15.151:0/1526801783 shutdown_connections 2022-03-15T05:50:21.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.365+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1526801783 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c79baf0 0x55a18c791bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.382 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.365+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1526801783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c75bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.365+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1526801783 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79cbd0 0x55a18c79b5b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.365+0000 7f750d40cb80 1 -- 172.21.15.151:0/1526801783 >> 172.21.15.151:0/1526801783 conn(0x55a18c75ac20 msgr2=0x55a18c7a06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:21.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.365+0000 7f750d40cb80 1 -- 172.21.15.151:0/1526801783 shutdown_connections 2022-03-15T05:50:21.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.365+0000 7f750d40cb80 1 -- 172.21.15.151:0/1526801783 wait complete. 2022-03-15T05:50:21.383 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.366+0000 7f750d40cb80 1 -- start start 2022-03-15T05:50:21.384 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.366+0000 7f750d40cb80 1 Processor -- start 2022-03-15T05:50:21.384 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.368+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 0x55a18c7ace10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.384 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.368+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7931c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.384 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.368+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c79cbd0 0x55a18c79e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.385 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.368+0000 7f750d40cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18c6aabc0 con 0x55a18c79cbd0 2022-03-15T05:50:21.385 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.368+0000 7f750d40cb80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18c5a7700 con 0x55a18c79baf0 2022-03-15T05:50:21.385 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.368+0000 7f750d40cb80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a18c793700 con 0x55a18c75b1c0 2022-03-15T05:50:21.385 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.368+0000 7f750d40cb80 10 client.0 _ll_register_callbacks cb 0x55a18c6545e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-15T05:50:21.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.368+0000 7f7502030700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c79cbd0 0x55a18c79e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f7502030700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c79cbd0 0x55a18c79e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60146/0 (socket says 172.21.15.151:60146) 2022-03-15T05:50:21.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f7502030700 1 -- 172.21.15.151:0/4042485393 learned_addr learned my addr 172.21.15.151:0/4042485393 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:21.386 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f750102e700 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7931c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f750182f700 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 0x55a18c7ace10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f7502030700 1 -- 172.21.15.151:0/4042485393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 msgr2=0x55a18c7ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:21.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f7502030700 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 0x55a18c7ace10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f7502030700 1 -- 172.21.15.151:0/4042485393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 msgr2=0x55a18c7931c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:21.387 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f7502030700 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7931c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:21.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f7502030700 1 -- 172.21.15.151:0/4042485393 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f80134b0 con 0x55a18c79cbd0 2022-03-15T05:50:21.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f750182f700 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 0x55a18c7ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:50:21.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f7502030700 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c79cbd0 0x55a18c79e5e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f74f4012980 tx=0x7f74f4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a260cf427a14910 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:21.388 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f74d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2022-03-15T05:50:21.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.369+0000 7f74d3fff700 1 -- 172.21.15.151:0/4042485393 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40050d0 con 0x55a18c79cbd0 2022-03-15T05:50:21.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f750d40cb80 1 -- 172.21.15.151:0/4042485393 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a18c74ffd0 con 0x55a18c79cbd0 2022-03-15T05:50:21.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f74d3fff700 1 -- 172.21.15.151:0/4042485393 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74f4005230 con 0x55a18c79cbd0 2022-03-15T05:50:21.389 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f74d3fff700 1 -- 172.21.15.151:0/4042485393 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74f4005600 con 0x55a18c79cbd0 2022-03-15T05:50:21.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f750d40cb80 10 client.4608 fetch_fsmap learned FSMap version 12 2022-03-15T05:50:21.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f750d40cb80 1 -- 172.21.15.151:0/4042485393 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x7f74fc159f80 con 0x55a18c79cbd0 2022-03-15T05:50:21.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f74d3fff700 1 -- 172.21.15.151:0/4042485393 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a18c74ffd0 con 0x55a18c79cbd0 2022-03-15T05:50:21.390 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f74d3fff700 1 -- 172.21.15.151:0/4042485393 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7f74f4003840 con 0x55a18c79cbd0 2022-03-15T05:50:21.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f750d40cb80 10 client.4608 fetch_fsmap finished waiting for FSMap version 12 2022-03-15T05:50:21.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f750d40cb80 10 client.4608 resolve_mds: resolved name 'e' to daemon mds.e 2022-03-15T05:50:21.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f750d40cb80 20 client.4608 populate_metadata read hostname 'smithi151' 2022-03-15T05:50:21.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f750d40cb80 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.151:6836/745076217,v1:172.21.15.151:6837/745076217] conn(0x55a18c7a0410 0x55a18c78e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:21.391 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f750d40cb80 4 client.4608 mds_command: new command op to 4284 tid=0[{"prefix": "get_command_descriptions"}] 2022-03-15T05:50:21.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.370+0000 7f750d40cb80 1 -- 172.21.15.151:0/4042485393 --> [v2:172.21.15.151:6836/745076217,v1:172.21.15.151:6837/745076217] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a18c72c690 con 0x55a18c7a0410 2022-03-15T05:50:21.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.371+0000 7f750182f700 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.151:6836/745076217,v1:172.21.15.151:6837/745076217] conn(0x55a18c7a0410 0x55a18c78e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:21.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.371+0000 7f74d3fff700 10 client.4608 ms_handle_connect on v2:172.21.15.151:6836/745076217 2022-03-15T05:50:21.392 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:21.371+0000 7f750182f700 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.151:6836/745076217,v1:172.21.15.151:6837/745076217] conn(0x55a18c7a0410 0x55a18c78e5a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ba3f9a8fe27d29dc server_cookie=becda7f5e4684004 in_seq=0 out_seq=0 2022-03-15T05:50:21.871 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T05:50:21.869+0000 7f18de513700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2022-03-15T05:50:23.714 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.711+0000 7f74d3fff700 1 -- 172.21.15.151:0/4042485393 <== mds.2 v2:172.21.15.151:6836/745076217 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x55a18c72c690 con 0x55a18c7a0410 2022-03-15T05:50:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.711+0000 7f74d3fff700 10 client.4608 handle_command_reply: tid=0 2022-03-15T05:50:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.711+0000 7f750d40cb80 1 client.4608 shutdown 2022-03-15T05:50:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.712+0000 7f750d40cb80 1 -- 172.21.15.151:0/4042485393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c79cbd0 msgr2=0x55a18c79e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:23.715 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.712+0000 7f750d40cb80 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c79cbd0 0x55a18c79e5e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f74f4012980 tx=0x7f74f4009040 comp rx=0 tx=0).stop 2022-03-15T05:50:23.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.712+0000 7f750d40cb80 1 -- 172.21.15.151:0/4042485393 shutdown_connections 2022-03-15T05:50:23.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.712+0000 7f750d40cb80 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.151:6836/745076217,v1:172.21.15.151:6837/745076217] conn(0x55a18c7a0410 0x55a18c78e5a0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.712+0000 7f750d40cb80 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c79cbd0 0x55a18c79e5e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.712+0000 7f750d40cb80 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 0x55a18c7ace10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.716 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.712+0000 7f750d40cb80 1 --2- 172.21.15.151:0/4042485393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7931c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.712+0000 7f74d3fff700 0 client.4608 ms_handle_reset on v2:172.21.15.151:6836/745076217 2022-03-15T05:50:23.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.712+0000 7f750d40cb80 1 -- 172.21.15.151:0/4042485393 >> 172.21.15.151:0/4042485393 conn(0x55a18c75ac20 msgr2=0x55a18c75b590 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:23.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.712+0000 7f750d40cb80 1 -- 172.21.15.151:0/4042485393 shutdown_connections 2022-03-15T05:50:23.717 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.713+0000 7f750d40cb80 1 -- 172.21.15.151:0/4042485393 wait complete. 2022-03-15T05:50:23.718 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.713+0000 7f750d40cb80 20 client.4608 trim_cache size 0 max 16384 2022-03-15T05:50:23.734 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.732+0000 7f750d40cb80 1 Processor -- start 2022-03-15T05:50:23.735 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.733+0000 7f750d40cb80 1 -- start start 2022-03-15T05:50:23.737 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75ac20 0x55a18c757b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.738 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c7af780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.738 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.738 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f750d40cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18c759f70 con 0x55a18c75b1c0 2022-03-15T05:50:23.738 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f750d40cb80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18c75c4a0 con 0x55a18c79baf0 2022-03-15T05:50:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f750d40cb80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a18c794350 con 0x55a18c75ac20 2022-03-15T05:50:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f750102e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c7af780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f7502030700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.739 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f750102e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c7af780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60148/0 (socket says 172.21.15.151:60148) 2022-03-15T05:50:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f750182f700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75ac20 0x55a18c757b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.734+0000 7f750102e700 1 -- 172.21.15.151:0/1196670809 learned_addr learned my addr 172.21.15.151:0/1196670809 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.735+0000 7f750102e700 1 -- 172.21.15.151:0/1196670809 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75ac20 msgr2=0x55a18c757b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.735+0000 7f750102e700 1 --2- 172.21.15.151:0/1196670809 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75ac20 0x55a18c757b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.740 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.735+0000 7f750102e700 1 -- 172.21.15.151:0/1196670809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 msgr2=0x55a18c7afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:23.741 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.735+0000 7f750102e700 1 --2- 172.21.15.151:0/1196670809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.741 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.735+0000 7f750102e700 1 -- 172.21.15.151:0/1196670809 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a18c4eeb10 con 0x55a18c75b1c0 2022-03-15T05:50:23.741 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.735+0000 7f750182f700 1 --2- 172.21.15.151:0/1196670809 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75ac20 0x55a18c757b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:23.741 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.735+0000 7f7502030700 1 --2- 172.21.15.151:0/1196670809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:23.742 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.735+0000 7f750102e700 1 --2- 172.21.15.151:0/1196670809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c7af780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f74ec051fa0 tx=0x7f74ec067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a08637e71572c7b server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:23.742 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.736+0000 7f74db7fe700 1 -- 172.21.15.151:0/1196670809 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec068040 con 0x55a18c75b1c0 2022-03-15T05:50:23.742 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.736+0000 7f74db7fe700 1 -- 172.21.15.151:0/1196670809 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec054280 con 0x55a18c75b1c0 2022-03-15T05:50:23.742 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.736+0000 7f74db7fe700 1 -- 172.21.15.151:0/1196670809 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec059d70 con 0x55a18c75b1c0 2022-03-15T05:50:23.748 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.736+0000 7f750d40cb80 1 -- 172.21.15.151:0/1196670809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 msgr2=0x55a18c7af780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:23.748 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.736+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1196670809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c7af780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f74ec051fa0 tx=0x7f74ec067000 comp rx=0 tx=0).stop 2022-03-15T05:50:23.748 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.736+0000 7f750d40cb80 1 -- 172.21.15.151:0/1196670809 shutdown_connections 2022-03-15T05:50:23.748 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.736+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1196670809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.749 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.736+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1196670809 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75ac20 0x55a18c757b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.749 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.736+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1196670809 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75b1c0 0x55a18c7af780 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.749 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.736+0000 7f750d40cb80 1 -- 172.21.15.151:0/1196670809 >> 172.21.15.151:0/1196670809 conn(0x55a18c756c40 msgr2=0x55a18c79b350 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:23.750 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.737+0000 7f750d40cb80 1 -- 172.21.15.151:0/1196670809 shutdown_connections 2022-03-15T05:50:23.750 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.737+0000 7f750d40cb80 1 -- 172.21.15.151:0/1196670809 wait complete. 2022-03-15T05:50:23.751 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.737+0000 7f750d40cb80 1 -- start start 2022-03-15T05:50:23.751 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.738+0000 7f750d40cb80 1 Processor -- start 2022-03-15T05:50:23.751 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75ac20 0x55a18c75b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.751 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 0x55a18c7561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.752 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750d40cb80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7ff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.752 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750d40cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18c75beb0 con 0x55a18c75ac20 2022-03-15T05:50:23.752 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750d40cb80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a18c7afd20 con 0x55a18c79baf0 2022-03-15T05:50:23.752 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750d40cb80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a18c757390 con 0x55a18c75b1c0 2022-03-15T05:50:23.752 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750d40cb80 10 client.0 _ll_register_callbacks cb 0x55a18c6545e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-15T05:50:23.753 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750182f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75ac20 0x55a18c75b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.753 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750102e700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 0x55a18c7561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.753 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750182f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75ac20 0x55a18c75b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60150/0 (socket says 172.21.15.151:60150) 2022-03-15T05:50:23.753 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f7502030700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.754 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.739+0000 7f750182f700 1 -- 172.21.15.151:0/1850607425 learned_addr learned my addr 172.21.15.151:0/1850607425 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:23.754 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f7502030700 1 -- 172.21.15.151:0/1850607425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 msgr2=0x55a18c7561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:23.754 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f7502030700 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 0x55a18c7561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.754 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f7502030700 1 -- 172.21.15.151:0/1850607425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75ac20 msgr2=0x55a18c75b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:23.754 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f7502030700 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75ac20 0x55a18c75b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.755 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f7502030700 1 -- 172.21.15.151:0/1850607425 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74f8014b20 con 0x55a18c79baf0 2022-03-15T05:50:23.755 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f750102e700 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 0x55a18c7561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:23.755 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f7502030700 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7ff020 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55a18c79b050 tx=0x7f74f401b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0812b321e73d4b1 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:23.755 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f74d3fff700 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2022-03-15T05:50:23.756 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f74d3fff700 1 -- 172.21.15.151:0/1850607425 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f40056d0 con 0x55a18c79baf0 2022-03-15T05:50:23.756 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f750d40cb80 1 -- 172.21.15.151:0/1850607425 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74ec0535b0 con 0x55a18c79baf0 2022-03-15T05:50:23.756 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.740+0000 7f74d3fff700 1 -- 172.21.15.151:0/1850607425 <== mon.1 v2:172.21.15.164:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f74f40125a0 con 0x55a18c79baf0 2022-03-15T05:50:23.756 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f74d3fff700 1 -- 172.21.15.151:0/1850607425 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74f4010730 con 0x55a18c79baf0 2022-03-15T05:50:23.756 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f750d40cb80 10 client.4666 fetch_fsmap learned FSMap version 12 2022-03-15T05:50:23.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f750d40cb80 1 -- 172.21.15.151:0/1850607425 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x7f74fc159f80 con 0x55a18c79baf0 2022-03-15T05:50:23.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f74d3fff700 1 -- 172.21.15.151:0/1850607425 <== mon.1 v2:172.21.15.164:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec0535b0 con 0x55a18c79baf0 2022-03-15T05:50:23.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f74d3fff700 1 -- 172.21.15.151:0/1850607425 <== mon.1 v2:172.21.15.164:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7f74f4006a20 con 0x55a18c79baf0 2022-03-15T05:50:23.757 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f750d40cb80 10 client.4666 fetch_fsmap finished waiting for FSMap version 12 2022-03-15T05:50:23.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f750d40cb80 10 client.4666 resolve_mds: resolved name 'e' to daemon mds.e 2022-03-15T05:50:23.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f750d40cb80 20 client.4666 populate_metadata read hostname 'smithi151' 2022-03-15T05:50:23.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.151:6836/745076217,v1:172.21.15.151:6837/745076217] conn(0x55a18c79cbd0 0x55a18c791690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f750d40cb80 4 client.4666 mds_command: new command op to 4284 tid=0[{"prefix": "status"}] 2022-03-15T05:50:23.758 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.741+0000 7f750d40cb80 1 -- 172.21.15.151:0/1850607425 --> [v2:172.21.15.151:6836/745076217,v1:172.21.15.151:6837/745076217] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a18c6504a0 con 0x55a18c79cbd0 2022-03-15T05:50:23.759 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.742+0000 7f750182f700 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.151:6836/745076217,v1:172.21.15.151:6837/745076217] conn(0x55a18c79cbd0 0x55a18c791690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.759 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.742+0000 7f74d3fff700 10 client.4666 ms_handle_connect on v2:172.21.15.151:6836/745076217 2022-03-15T05:50:23.759 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.742+0000 7f750182f700 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.151:6836/745076217,v1:172.21.15.151:6837/745076217] conn(0x55a18c79cbd0 0x55a18c791690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1d07361b94c65786 server_cookie=8d1164902d7f1dde in_seq=0 out_seq=0 2022-03-15T05:50:23.759 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.742+0000 7f74d3fff700 1 -- 172.21.15.151:0/1850607425 <== mds.2 v2:172.21.15.151:6836/745076217 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55a18c6504a0 con 0x55a18c79cbd0 2022-03-15T05:50:23.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.742+0000 7f74d3fff700 10 client.4666 handle_command_reply: tid=0 2022-03-15T05:50:23.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.742+0000 7f750d40cb80 1 client.4666 shutdown 2022-03-15T05:50:23.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 1 -- 172.21.15.151:0/1850607425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 msgr2=0x55a18c7ff020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:23.760 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7ff020 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x55a18c79b050 tx=0x7f74f401b000 comp rx=0 tx=0).stop 2022-03-15T05:50:23.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 1 -- 172.21.15.151:0/1850607425 shutdown_connections 2022-03-15T05:50:23.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.151:6836/745076217,v1:172.21.15.151:6837/745076217] conn(0x55a18c79cbd0 0x55a18c791690 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a18c79baf0 0x55a18c7ff020 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.761 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a18c75ac20 0x55a18c75b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f74d3fff700 0 client.4666 ms_handle_reset on v2:172.21.15.151:6836/745076217 2022-03-15T05:50:23.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 1 --2- 172.21.15.151:0/1850607425 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55a18c75b1c0 0x55a18c7561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 1 -- 172.21.15.151:0/1850607425 >> 172.21.15.151:0/1850607425 conn(0x55a18c756c40 msgr2=0x55a18c793d90 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:23.762 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 1 -- 172.21.15.151:0/1850607425 shutdown_connections 2022-03-15T05:50:23.763 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 1 -- 172.21.15.151:0/1850607425 wait complete. 2022-03-15T05:50:23.763 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.743+0000 7f750d40cb80 20 client.4666 trim_cache size 0 max 16384 2022-03-15T05:50:23.763 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2022-03-15T05:50:23.763 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c", 2022-03-15T05:50:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 2, 2022-03-15T05:50:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4284, 2022-03-15T05:50:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2022-03-15T05:50:23.764 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2022-03-15T05:50:23.765 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2022-03-15T05:50:23.765 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 11.012857849, 2022-03-15T05:50:23.765 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 12, 2022-03-15T05:50:23.765 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 24, 2022-03-15T05:50:23.765 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 24, 2022-03-15T05:50:23.766 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 27.781376108 2022-03-15T05:50:23.766 INFO:teuthology.orchestra.run.smithi151.stdout:} 2022-03-15T05:50:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 -- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f74dc0633c0 msgr2=0x7f74dc065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:23.767 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f74dc0633c0 0x7f74dc065870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f74f8007fd0 tx=0x7f74f8007d10 comp rx=0 tx=0).stop 2022-03-15T05:50:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 -- 172.21.15.151:0/1985224353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cb5c0 msgr2=0x7f74fc168220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cb5c0 0x7f74fc168220 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f74fc0688a0 tx=0x7f74ec017000 comp rx=0 tx=0).stop 2022-03-15T05:50:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 -- 172.21.15.151:0/1985224353 shutdown_connections 2022-03-15T05:50:23.768 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f74dc0633c0 0x7f74dc065870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f74fc155cf0 0x7f74fc1502b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f74fc0cb1f0 0x7f74fc153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 --2- 172.21.15.151:0/1985224353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74fc0cb5c0 0x7f74fc168220 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 -- 172.21.15.151:0/1985224353 >> 172.21.15.151:0/1985224353 conn(0x7f74fc068e90 msgr2=0x7f74fc152650 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:23.769 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 -- 172.21.15.151:0/1985224353 shutdown_connections 2022-03-15T05:50:23.770 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.744+0000 7f7503a93700 1 -- 172.21.15.151:0/1985224353 wait complete. 2022-03-15T05:50:23.772 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2022-03-15T05:50:23.983 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.981+0000 7f2092c0c700 1 Processor -- start 2022-03-15T05:50:23.983 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.981+0000 7f2092c0c700 1 -- start start 2022-03-15T05:50:23.985 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.982+0000 7f2092c0c700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f208c1574f0 0x7f208c1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.986 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.982+0000 7f2092c0c700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208c0cbe00 con 0x7f208c155430 2022-03-15T05:50:23.986 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.982+0000 7f2092c0c700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208c0befb0 con 0x7f208c0c57a0 2022-03-15T05:50:23.986 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.982+0000 7f2092c0c700 1 -- --> v2:172.21.15.164:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208c14f270 con 0x7f208c1574f0 2022-03-15T05:50:23.986 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.983+0000 7f2091c0a700 1 --2- >> v2:172.21.15.164:3300/0 conn(0x7f208c1574f0 0x7f208c1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.987 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.983+0000 7f2091409700 1 --1- >> v1:172.21.15.164:6789/0 conn(0x7f208c0c57a0 0x7f208c0c1360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33696/0 (socket says 172.21.15.151:33696) 2022-03-15T05:50:23.987 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.983+0000 7f2091409700 1 -- 172.21.15.151:0/2132263375 learned_addr learned my addr 172.21.15.151:0/2132263375 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:23.987 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.983+0000 7f2091c0a700 1 -- 172.21.15.151:0/2132263375 >> v1:172.21.15.164:6789/0 conn(0x7f208c0c57a0 legacy=0x7f208c0c1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:23.987 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.983+0000 7f2090c08700 1 -- 172.21.15.151:0/2132263375 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418408040 0 0) 0x7f208c0befb0 con 0x7f208c0c57a0 2022-03-15T05:50:23.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.983+0000 7f2091c0a700 1 -- 172.21.15.151:0/2132263375 >> v1:172.21.15.151:6789/0 conn(0x7f208c155430 legacy=0x7f208c0bf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:23.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.983+0000 7f2091c0a700 1 -- 172.21.15.151:0/2132263375 --> v2:172.21.15.164:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c089030 con 0x7f208c1574f0 2022-03-15T05:50:23.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.983+0000 7f2091c0a700 1 --2- 172.21.15.151:0/2132263375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f208c1574f0 0x7f208c1578c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2088006fd0 tx=0x7f2088006f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d7e745b3c188affc server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:23.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.984+0000 7f2090c08700 1 -- 172.21.15.151:0/2132263375 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088004030 con 0x7f208c1574f0 2022-03-15T05:50:23.988 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.984+0000 7f2090c08700 1 -- 172.21.15.151:0/2132263375 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2088004190 con 0x7f208c1574f0 2022-03-15T05:50:23.989 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.984+0000 7f2090c08700 1 -- 172.21.15.151:0/2132263375 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088005a90 con 0x7f208c1574f0 2022-03-15T05:50:23.992 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.984+0000 7f2092c0c700 1 -- 172.21.15.151:0/2132263375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f208c1574f0 msgr2=0x7f208c1578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:23.992 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.984+0000 7f2092c0c700 1 --2- 172.21.15.151:0/2132263375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f208c1574f0 0x7f208c1578c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2088006fd0 tx=0x7f2088006f40 comp rx=0 tx=0).stop 2022-03-15T05:50:23.992 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.984+0000 7f2092c0c700 1 -- 172.21.15.151:0/2132263375 shutdown_connections 2022-03-15T05:50:23.992 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.984+0000 7f2092c0c700 1 --2- 172.21.15.151:0/2132263375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f208c1574f0 0x7f208c1578c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.993 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.984+0000 7f2092c0c700 1 -- 172.21.15.151:0/2132263375 >> 172.21.15.151:0/2132263375 conn(0x7f208c068d50 msgr2=0x7f208c069150 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:23.993 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.984+0000 7f2092c0c700 1 -- 172.21.15.151:0/2132263375 shutdown_connections 2022-03-15T05:50:23.993 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.984+0000 7f2092c0c700 1 -- 172.21.15.151:0/2132263375 wait complete. 2022-03-15T05:50:23.993 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.986+0000 7f2092c0c700 1 Processor -- start 2022-03-15T05:50:23.994 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.986+0000 7f2092c0c700 1 -- start start 2022-03-15T05:50:23.994 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f2092c0c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f208c0c57a0 0x7f208c14a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.994 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f2092c0c700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f208c155430 0x7f208c0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.994 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f2092c0c700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f208c1574f0 0x7f208c0c4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:23.994 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f2092c0c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0c83e0 con 0x7f208c0c57a0 2022-03-15T05:50:23.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f2092c0c700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c14b260 con 0x7f208c155430 2022-03-15T05:50:23.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f2092c0c700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0c2300 con 0x7f208c1574f0 2022-03-15T05:50:23.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f2091c0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f208c0c57a0 0x7f208c14a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.995 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f2091c0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f208c0c57a0 0x7f208c14a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60152/0 (socket says 172.21.15.151:60152) 2022-03-15T05:50:23.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f2091c0a700 1 -- 172.21.15.151:0/439650022 learned_addr learned my addr 172.21.15.151:0/439650022 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:23.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f2091409700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f208c155430 0x7f208c0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.987+0000 7f209240b700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f208c1574f0 0x7f208c0c4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:23.996 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.988+0000 7f2091c0a700 1 -- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f208c1574f0 msgr2=0x7f208c0c4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:23.997 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.988+0000 7f2091c0a700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f208c1574f0 0x7f208c0c4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.997 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.988+0000 7f2091c0a700 1 -- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f208c155430 msgr2=0x7f208c0c4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:23.997 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.988+0000 7f2091c0a700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f208c155430 0x7f208c0c4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:23.997 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.988+0000 7f2091c0a700 1 -- 172.21.15.151:0/439650022 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2088009250 con 0x7f208c0c57a0 2022-03-15T05:50:23.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.988+0000 7f2091c0a700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f208c0c57a0 0x7f208c14a650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20880062d0 tx=0x7f2088015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:23.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.988+0000 7f2079ffb700 1 -- 172.21.15.151:0/439650022 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088006790 con 0x7f208c0c57a0 2022-03-15T05:50:23.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.988+0000 7f2079ffb700 1 -- 172.21.15.151:0/439650022 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20880034e0 con 0x7f208c0c57a0 2022-03-15T05:50:23.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.988+0000 7f2092c0c700 1 -- 172.21.15.151:0/439650022 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f208c0c8140 con 0x7f208c0c57a0 2022-03-15T05:50:23.998 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.988+0000 7f2079ffb700 1 -- 172.21.15.151:0/439650022 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20880038a0 con 0x7f208c0c57a0 2022-03-15T05:50:23.999 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.989+0000 7f2092c0c700 1 -- 172.21.15.151:0/439650022 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c164ed0 con 0x7f208c0c57a0 2022-03-15T05:50:24.006 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.991+0000 7f2079ffb700 1 -- 172.21.15.151:0/439650022 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f208800f050 con 0x7f208c0c57a0 2022-03-15T05:50:24.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.992+0000 7f2079ffb700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f206c0633c0 0x7f206c065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.992+0000 7f2079ffb700 1 -- 172.21.15.151:0/439650022 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f20880819b0 con 0x7f208c0c57a0 2022-03-15T05:50:24.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.993+0000 7f2091409700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f206c0633c0 0x7f206c065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.007 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.993+0000 7f2091409700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f206c0633c0 0x7f206c065870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f208c159f20 tx=0x7f207c007ba0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.994+0000 7f209d7e7b80 1 Processor -- start 2022-03-15T05:50:24.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.994+0000 7f209d7e7b80 1 -- start start 2022-03-15T05:50:24.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.995+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0931a50 0x5649d09660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.995+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0973f90 0x5649d09665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.008 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.995+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d0978ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.995+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649d08ad540 con 0x5649d0931a50 2022-03-15T05:50:24.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.995+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649d081b8a0 con 0x5649d092eed0 2022-03-15T05:50:24.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.995+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649d0883ae0 con 0x5649d0973f90 2022-03-15T05:50:24.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.995+0000 7f2091c0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0931a50 0x5649d09660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.009 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.995+0000 7f2091c0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0931a50 0x5649d09660a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60154/0 (socket says 172.21.15.151:60154) 2022-03-15T05:50:24.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2091c0a700 1 -- 172.21.15.151:0/73925903 learned_addr learned my addr 172.21.15.151:0/73925903 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2091409700 1 --2- 172.21.15.151:0/73925903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0973f90 0x5649d09665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f209240b700 1 --2- 172.21.15.151:0/73925903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d0978ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.010 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2091c0a700 1 -- 172.21.15.151:0/73925903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0973f90 msgr2=0x5649d09665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2091c0a700 1 --2- 172.21.15.151:0/73925903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0973f90 0x5649d09665e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2091c0a700 1 -- 172.21.15.151:0/73925903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 msgr2=0x5649d0978ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2091c0a700 1 --2- 172.21.15.151:0/73925903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d0978ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2091c0a700 1 -- 172.21.15.151:0/73925903 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649d0773890 con 0x5649d0931a50 2022-03-15T05:50:24.011 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f209240b700 1 --2- 172.21.15.151:0/73925903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d0978ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:24.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2091c0a700 1 --2- 172.21.15.151:0/73925903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0931a50 0x5649d09660a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2088004160 tx=0x7f20880069e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de98ca03878de5fa server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2072ffd700 1 -- 172.21.15.151:0/73925903 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088081070 con 0x5649d0931a50 2022-03-15T05:50:24.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2072ffd700 1 -- 172.21.15.151:0/73925903 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2088054c40 con 0x5649d0931a50 2022-03-15T05:50:24.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.996+0000 7f2072ffd700 1 -- 172.21.15.151:0/73925903 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208805a730 con 0x5649d0931a50 2022-03-15T05:50:24.012 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.997+0000 7f209d7e7b80 1 -- 172.21.15.151:0/73925903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0931a50 msgr2=0x5649d09660a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.997+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/73925903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0931a50 0x5649d09660a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2088004160 tx=0x7f20880069e0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.997+0000 7f209d7e7b80 1 -- 172.21.15.151:0/73925903 shutdown_connections 2022-03-15T05:50:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.997+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/73925903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d0978ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.013 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.997+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/73925903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0931a50 0x5649d09660a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.997+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/73925903 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0973f90 0x5649d09665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.997+0000 7f209d7e7b80 1 -- 172.21.15.151:0/73925903 >> 172.21.15.151:0/73925903 conn(0x5649d092ddc0 msgr2=0x5649d0973880 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.997+0000 7f209d7e7b80 1 -- 172.21.15.151:0/73925903 shutdown_connections 2022-03-15T05:50:24.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.997+0000 7f209d7e7b80 1 -- 172.21.15.151:0/73925903 wait complete. 2022-03-15T05:50:24.014 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.998+0000 7f209d7e7b80 1 -- start start 2022-03-15T05:50:24.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.998+0000 7f209d7e7b80 1 Processor -- start 2022-03-15T05:50:24.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.999+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 0x5649d092fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.999+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0931a50 0x5649d097fac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.015 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.999+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0973f90 0x5649d0961570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.999+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649d087dbc0 con 0x5649d092eed0 2022-03-15T05:50:24.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.999+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649d077a700 con 0x5649d0973f90 2022-03-15T05:50:24.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.999+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649d097f670 con 0x5649d0931a50 2022-03-15T05:50:24.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:23.999+0000 7f209d7e7b80 10 client.0 _ll_register_callbacks cb 0x5649d08275e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-15T05:50:24.016 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f2091409700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0931a50 0x5649d097fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f209240b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0973f90 0x5649d0961570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f209240b700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0973f90 0x5649d0961570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57376/0 (socket says 172.21.15.151:57376) 2022-03-15T05:50:24.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f2091c0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 0x5649d092fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.017 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f209240b700 1 -- 172.21.15.151:0/4197097607 learned_addr learned my addr 172.21.15.151:0/4197097607 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f209240b700 1 -- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0931a50 msgr2=0x5649d097fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f209240b700 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0931a50 0x5649d097fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f209240b700 1 -- 172.21.15.151:0/4197097607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 msgr2=0x5649d092fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.018 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f209240b700 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 0x5649d092fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f209240b700 1 -- 172.21.15.151:0/4197097607 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c0cbe00 con 0x5649d0973f90 2022-03-15T05:50:24.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f209240b700 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0973f90 0x5649d0961570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2084012720 tx=0x7f2084009040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61e1316d0764bd27 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f2067fff700 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2022-03-15T05:50:24.019 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.000+0000 7f2067fff700 1 -- 172.21.15.151:0/4197097607 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20840052e0 con 0x5649d0973f90 2022-03-15T05:50:24.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f2067fff700 1 -- 172.21.15.151:0/4197097607 <== mon.1 v2:172.21.15.164:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2084005440 con 0x5649d0973f90 2022-03-15T05:50:24.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f209d7e7b80 1 -- 172.21.15.151:0/4197097607 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5649d0922fd0 con 0x5649d0973f90 2022-03-15T05:50:24.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f2067fff700 1 -- 172.21.15.151:0/4197097607 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2084003840 con 0x5649d0973f90 2022-03-15T05:50:24.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f209d7e7b80 10 client.4681 fetch_fsmap learned FSMap version 12 2022-03-15T05:50:24.020 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f209d7e7b80 1 -- 172.21.15.151:0/4197097607 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x7f208c164ed0 con 0x5649d0973f90 2022-03-15T05:50:24.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f2067fff700 1 -- 172.21.15.151:0/4197097607 <== mon.1 v2:172.21.15.164:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5649d0922fd0 con 0x5649d0973f90 2022-03-15T05:50:24.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f2067fff700 1 -- 172.21.15.151:0/4197097607 <== mon.1 v2:172.21.15.164:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7f20840039a0 con 0x5649d0973f90 2022-03-15T05:50:24.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f209d7e7b80 10 client.4681 fetch_fsmap finished waiting for FSMap version 12 2022-03-15T05:50:24.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f209d7e7b80 10 client.4681 resolve_mds: resolved name 'd' to daemon mds.d 2022-03-15T05:50:24.021 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f209d7e7b80 20 client.4681 populate_metadata read hostname 'smithi151' 2022-03-15T05:50:24.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:6835/4178735378,v1:172.21.15.164:6838/4178735378] conn(0x5649d0963950 0x5649d0963d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f209d7e7b80 4 client.4681 mds_command: new command op to 4300 tid=0[{"prefix": "get_command_descriptions"}] 2022-03-15T05:50:24.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.001+0000 7f209d7e7b80 1 -- 172.21.15.151:0/4197097607 --> [v2:172.21.15.164:6835/4178735378,v1:172.21.15.164:6838/4178735378] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5649d08ff690 con 0x5649d0963950 2022-03-15T05:50:24.022 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.002+0000 7f2091c0a700 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:6835/4178735378,v1:172.21.15.164:6838/4178735378] conn(0x5649d0963950 0x5649d0963d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.002+0000 7f2067fff700 10 client.4681 ms_handle_connect on v2:172.21.15.164:6835/4178735378 2022-03-15T05:50:24.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.002+0000 7f2091c0a700 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:6835/4178735378,v1:172.21.15.164:6838/4178735378] conn(0x5649d0963950 0x5649d0963d20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3f02fc20be16d8d server_cookie=a00885a21edb382c in_seq=0 out_seq=0 2022-03-15T05:50:24.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f2067fff700 1 -- 172.21.15.151:0/4197097607 <== mds.1 v2:172.21.15.164:6835/4178735378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x5649d08ff690 con 0x5649d0963950 2022-03-15T05:50:24.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f2067fff700 10 client.4681 handle_command_reply: tid=0 2022-03-15T05:50:24.023 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 client.4681 shutdown 2022-03-15T05:50:24.024 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 -- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0973f90 msgr2=0x5649d0961570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.024 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0973f90 0x5649d0961570 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2084012720 tx=0x7f2084009040 comp rx=0 tx=0).stop 2022-03-15T05:50:24.024 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 -- 172.21.15.151:0/4197097607 shutdown_connections 2022-03-15T05:50:24.024 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:6835/4178735378,v1:172.21.15.164:6838/4178735378] conn(0x5649d0963950 0x5649d0963d20 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.025 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0973f90 0x5649d0961570 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.025 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 0x5649d092fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.025 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f2067fff700 0 client.4681 ms_handle_reset on v2:172.21.15.164:6835/4178735378 2022-03-15T05:50:24.025 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/4197097607 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0931a50 0x5649d097fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.025 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 -- 172.21.15.151:0/4197097607 >> 172.21.15.151:0/4197097607 conn(0x5649d092ddc0 msgr2=0x5649d092a330 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.026 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 -- 172.21.15.151:0/4197097607 shutdown_connections 2022-03-15T05:50:24.026 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 1 -- 172.21.15.151:0/4197097607 wait complete. 2022-03-15T05:50:24.026 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.003+0000 7f209d7e7b80 20 client.4681 trim_cache size 0 max 16384 2022-03-15T05:50:24.033 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.021+0000 7f209d7e7b80 1 Processor -- start 2022-03-15T05:50:24.033 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.021+0000 7f209d7e7b80 1 -- start start 2022-03-15T05:50:24.034 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 0x5649d09707d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.034 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0931a50 0x5649d0970d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.034 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0973f90 0x5649d096d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.034 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649d096ac90 con 0x5649d092eed0 2022-03-15T05:50:24.035 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649d0922fa0 con 0x5649d0931a50 2022-03-15T05:50:24.035 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649d092aa90 con 0x5649d0973f90 2022-03-15T05:50:24.035 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f2091c0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 0x5649d09707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.035 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f2091c0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 0x5649d09707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60158/0 (socket says 172.21.15.151:60158) 2022-03-15T05:50:24.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f2091c0a700 1 -- 172.21.15.151:0/1285948979 learned_addr learned my addr 172.21.15.151:0/1285948979 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f209240b700 1 --2- 172.21.15.151:0/1285948979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0973f90 0x5649d096d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f2091409700 1 --2- 172.21.15.151:0/1285948979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0931a50 0x5649d0970d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.036 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f2091c0a700 1 -- 172.21.15.151:0/1285948979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0973f90 msgr2=0x5649d096d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.037 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f2091c0a700 1 --2- 172.21.15.151:0/1285948979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0973f90 0x5649d096d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.037 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f2091c0a700 1 -- 172.21.15.151:0/1285948979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0931a50 msgr2=0x5649d0970d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.037 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f2091c0a700 1 --2- 172.21.15.151:0/1285948979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0931a50 0x5649d0970d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.037 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.022+0000 7f2091c0a700 1 -- 172.21.15.151:0/1285948979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5649d06c1b10 con 0x5649d092eed0 2022-03-15T05:50:24.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f2091c0a700 1 --2- 172.21.15.151:0/1285948979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 0x5649d09707d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2088052960 tx=0x7f2088067000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e5d21036efa416 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f20737fe700 1 -- 172.21.15.151:0/1285948979 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208807fe90 con 0x5649d092eed0 2022-03-15T05:50:24.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f20737fe700 1 -- 172.21.15.151:0/1285948979 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208805a730 con 0x5649d092eed0 2022-03-15T05:50:24.038 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f20737fe700 1 -- 172.21.15.151:0/1285948979 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088006580 con 0x5649d092eed0 2022-03-15T05:50:24.039 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f209d7e7b80 1 -- 172.21.15.151:0/1285948979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 msgr2=0x5649d09707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.039 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/1285948979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 0x5649d09707d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2088052960 tx=0x7f2088067000 comp rx=0 tx=0).stop 2022-03-15T05:50:24.039 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f209d7e7b80 1 -- 172.21.15.151:0/1285948979 shutdown_connections 2022-03-15T05:50:24.039 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/1285948979 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0973f90 0x5649d096d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.039 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/1285948979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d092eed0 0x5649d09707d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.040 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/1285948979 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d0931a50 0x5649d0970d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.040 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.023+0000 7f209d7e7b80 1 -- 172.21.15.151:0/1285948979 >> 172.21.15.151:0/1285948979 conn(0x5649d092ddc0 msgr2=0x5649d092fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.040 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.024+0000 7f209d7e7b80 1 -- 172.21.15.151:0/1285948979 shutdown_connections 2022-03-15T05:50:24.040 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.024+0000 7f209d7e7b80 1 -- 172.21.15.151:0/1285948979 wait complete. 2022-03-15T05:50:24.040 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.024+0000 7f209d7e7b80 1 -- start start 2022-03-15T05:50:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.024+0000 7f209d7e7b80 1 Processor -- start 2022-03-15T05:50:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.025+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d096dd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.025+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0931a50 0x5649d092e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.041 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.025+0000 7f209d7e7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0973f90 0x5649d09cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.025+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649d096e2d0 con 0x5649d0973f90 2022-03-15T05:50:24.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.025+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x5649d0969d70 con 0x5649d092eed0 2022-03-15T05:50:24.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.025+0000 7f209d7e7b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x5649d0970ba0 con 0x5649d0931a50 2022-03-15T05:50:24.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.025+0000 7f209d7e7b80 10 client.0 _ll_register_callbacks cb 0x5649d08275e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-15T05:50:24.042 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2091c0a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d096dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.043 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f209240b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0973f90 0x5649d09cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.043 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2091409700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0931a50 0x5649d092e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.043 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2091c0a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d096dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57380/0 (socket says 172.21.15.151:57380) 2022-03-15T05:50:24.043 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2091c0a700 1 -- 172.21.15.151:0/198552845 learned_addr learned my addr 172.21.15.151:0/198552845 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.044 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2091c0a700 1 -- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0931a50 msgr2=0x5649d092e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.044 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2091c0a700 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0931a50 0x5649d092e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.044 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2091c0a700 1 -- 172.21.15.151:0/198552845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0973f90 msgr2=0x5649d09cefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.044 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2091c0a700 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0973f90 0x5649d09cefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.044 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2091c0a700 1 -- 172.21.15.151:0/198552845 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208807e040 con 0x5649d092eed0 2022-03-15T05:50:24.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f209240b700 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0973f90 0x5649d09cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:24.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2091c0a700 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d096dd90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2088054540 tx=0x7f208800b050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fda38f6403ab7536 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.026+0000 7f2067fff700 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2022-03-15T05:50:24.045 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f2067fff700 1 -- 172.21.15.151:0/198552845 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2088019e60 con 0x5649d092eed0 2022-03-15T05:50:24.046 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f2067fff700 1 -- 172.21.15.151:0/198552845 <== mon.1 v2:172.21.15.164:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2088059050 con 0x5649d092eed0 2022-03-15T05:50:24.046 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f209d7e7b80 1 -- 172.21.15.151:0/198552845 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2088054c40 con 0x5649d092eed0 2022-03-15T05:50:24.046 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f2067fff700 1 -- 172.21.15.151:0/198552845 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2088059210 con 0x5649d092eed0 2022-03-15T05:50:24.046 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f209d7e7b80 10 client.4687 fetch_fsmap learned FSMap version 12 2022-03-15T05:50:24.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f209d7e7b80 1 -- 172.21.15.151:0/198552845 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x5649d06e8160 con 0x5649d092eed0 2022-03-15T05:50:24.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f2067fff700 1 -- 172.21.15.151:0/198552845 <== mon.1 v2:172.21.15.164:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2088054c40 con 0x5649d092eed0 2022-03-15T05:50:24.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f2067fff700 1 -- 172.21.15.151:0/198552845 <== mon.1 v2:172.21.15.164:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7f2088053b00 con 0x5649d092eed0 2022-03-15T05:50:24.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f209d7e7b80 10 client.4687 fetch_fsmap finished waiting for FSMap version 12 2022-03-15T05:50:24.047 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f209d7e7b80 10 client.4687 resolve_mds: resolved name 'd' to daemon mds.d 2022-03-15T05:50:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f209d7e7b80 20 client.4687 populate_metadata read hostname 'smithi151' 2022-03-15T05:50:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:6835/4178735378,v1:172.21.15.164:6838/4178735378] conn(0x5649d09cf4e0 0x5649d097bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f209d7e7b80 4 client.4687 mds_command: new command op to 4300 tid=0[{"prefix": "status"}] 2022-03-15T05:50:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f209d7e7b80 1 -- 172.21.15.151:0/198552845 --> [v2:172.21.15.164:6835/4178735378,v1:172.21.15.164:6838/4178735378] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5649d08234a0 con 0x5649d09cf4e0 2022-03-15T05:50:24.048 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.027+0000 7f2091409700 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:6835/4178735378,v1:172.21.15.164:6838/4178735378] conn(0x5649d09cf4e0 0x5649d097bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.028+0000 7f2067fff700 10 client.4687 ms_handle_connect on v2:172.21.15.164:6835/4178735378 2022-03-15T05:50:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.028+0000 7f2091409700 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:6835/4178735378,v1:172.21.15.164:6838/4178735378] conn(0x5649d09cf4e0 0x5649d097bf50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2322f10909ac66d server_cookie=239ada3c0870712a in_seq=0 out_seq=0 2022-03-15T05:50:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.028+0000 7f2067fff700 1 -- 172.21.15.151:0/198552845 <== mds.1 v2:172.21.15.164:6835/4178735378 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x5649d08234a0 con 0x5649d09cf4e0 2022-03-15T05:50:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.028+0000 7f2067fff700 10 client.4687 handle_command_reply: tid=0 2022-03-15T05:50:24.049 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.028+0000 7f209d7e7b80 1 client.4687 shutdown 2022-03-15T05:50:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.028+0000 7f209d7e7b80 1 -- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 msgr2=0x5649d096dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.028+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d096dd90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2088054540 tx=0x7f208800b050 comp rx=0 tx=0).stop 2022-03-15T05:50:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f209d7e7b80 1 -- 172.21.15.151:0/198552845 shutdown_connections 2022-03-15T05:50:24.050 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:6835/4178735378,v1:172.21.15.164:6838/4178735378] conn(0x5649d09cf4e0 0x5649d097bf50 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5649d0973f90 0x5649d09cefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5649d092eed0 0x5649d096dd90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f209d7e7b80 1 --2- 172.21.15.151:0/198552845 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x5649d0931a50 0x5649d092e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f2067fff700 0 client.4687 ms_handle_reset on v2:172.21.15.164:6835/4178735378 2022-03-15T05:50:24.051 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f209d7e7b80 1 -- 172.21.15.151:0/198552845 >> 172.21.15.151:0/198552845 conn(0x5649d092ddc0 msgr2=0x5649d09658e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.052 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f209d7e7b80 1 -- 172.21.15.151:0/198552845 shutdown_connections 2022-03-15T05:50:24.052 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f209d7e7b80 1 -- 172.21.15.151:0/198552845 wait complete. 2022-03-15T05:50:24.052 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f209d7e7b80 20 client.4687 trim_cache size 0 max 16384 2022-03-15T05:50:24.052 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2022-03-15T05:50:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c", 2022-03-15T05:50:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 1, 2022-03-15T05:50:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4300, 2022-03-15T05:50:24.053 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2022-03-15T05:50:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2022-03-15T05:50:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2022-03-15T05:50:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 16.371814601000001, 2022-03-15T05:50:24.054 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 12, 2022-03-15T05:50:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 24, 2022-03-15T05:50:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 24, 2022-03-15T05:50:24.055 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 28.180875017999998 2022-03-15T05:50:24.055 INFO:teuthology.orchestra.run.smithi151.stdout:} 2022-03-15T05:50:24.057 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f2092c0c700 1 -- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f206c0633c0 msgr2=0x7f206c065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.057 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f2092c0c700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f206c0633c0 0x7f206c065870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f208c159f20 tx=0x7f207c007ba0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.057 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.029+0000 7f2092c0c700 1 -- 172.21.15.151:0/439650022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f208c0c57a0 msgr2=0x7f208c14a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.058 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.030+0000 7f2092c0c700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f208c0c57a0 0x7f208c14a650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f20880062d0 tx=0x7f2088015000 comp rx=0 tx=0).stop 2022-03-15T05:50:24.058 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.030+0000 7f2092c0c700 1 -- 172.21.15.151:0/439650022 shutdown_connections 2022-03-15T05:50:24.058 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.030+0000 7f2092c0c700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f206c0633c0 0x7f206c065870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.058 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.030+0000 7f2092c0c700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f208c1574f0 0x7f208c0c4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.059 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.030+0000 7f2092c0c700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f208c0c57a0 0x7f208c14a650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.059 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.030+0000 7f2092c0c700 1 --2- 172.21.15.151:0/439650022 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f208c155430 0x7f208c0c4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.059 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.030+0000 7f2092c0c700 1 -- 172.21.15.151:0/439650022 >> 172.21.15.151:0/439650022 conn(0x7f208c068d50 msgr2=0x7f208c14e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.059 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.030+0000 7f2092c0c700 1 -- 172.21.15.151:0/439650022 shutdown_connections 2022-03-15T05:50:24.059 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.030+0000 7f2092c0c700 1 -- 172.21.15.151:0/439650022 wait complete. 2022-03-15T05:50:24.060 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2022-03-15T05:50:24.267 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.265+0000 7f9e3f029700 1 Processor -- start 2022-03-15T05:50:24.268 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.265+0000 7f9e3f029700 1 -- start start 2022-03-15T05:50:24.269 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.267+0000 7f9e3f029700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e38067ba0 0x7f9e38151750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.269 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.267+0000 7f9e3f029700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380c14f0 con 0x7f9e380c2220 2022-03-15T05:50:24.269 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.267+0000 7f9e3f029700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380c1d90 con 0x7f9e380bd750 2022-03-15T05:50:24.270 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.267+0000 7f9e3f029700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3814b4e0 con 0x7f9e38067ba0 2022-03-15T05:50:24.270 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.267+0000 7f9e37fff700 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f9e380c2220 0x7f9e38066980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53242/0 (socket says 172.21.15.151:53242) 2022-03-15T05:50:24.270 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.267+0000 7f9e37fff700 1 -- 172.21.15.151:0/4019582494 learned_addr learned my addr 172.21.15.151:0/4019582494 (peer_addr_for_me v1:172.21.15.151:0/0) 2022-03-15T05:50:24.270 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.267+0000 7f9e3d5c6700 1 --2- 172.21.15.151:0/4019582494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e38067ba0 0x7f9e38151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.272 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.267+0000 7f9e377fe700 1 -- 172.21.15.151:0/4019582494 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1197048889 0 0) 0x7f9e380c1d90 con 0x7f9e380bd750 2022-03-15T05:50:24.273 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.268+0000 7f9e377fe700 1 -- 172.21.15.151:0/4019582494 --> v1:172.21.15.164:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e1c0033f0 con 0x7f9e380bd750 2022-03-15T05:50:24.273 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.268+0000 7f9e377fe700 1 -- 172.21.15.151:0/4019582494 <== mon.0 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 403291369 0 0) 0x7f9e380c14f0 con 0x7f9e380c2220 2022-03-15T05:50:24.273 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.268+0000 7f9e377fe700 1 -- 172.21.15.151:0/4019582494 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e380c1d90 con 0x7f9e380c2220 2022-03-15T05:50:24.273 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.268+0000 7f9e3d5c6700 1 -- 172.21.15.151:0/4019582494 >> v1:172.21.15.164:6789/0 conn(0x7f9e380bd750 legacy=0x7f9e3806c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.274 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.268+0000 7f9e3d5c6700 1 -- 172.21.15.151:0/4019582494 >> v1:172.21.15.151:6789/0 conn(0x7f9e380c2220 legacy=0x7f9e38066980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.274 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.268+0000 7f9e3d5c6700 1 -- 172.21.15.151:0/4019582494 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380c2a10 con 0x7f9e38067ba0 2022-03-15T05:50:24.274 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.268+0000 7f9e3d5c6700 1 --2- 172.21.15.151:0/4019582494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e38067ba0 0x7f9e38151750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000afa0 tx=0x7f9e3000a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=925144ffe1cf53a1 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.274 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.268+0000 7f9e377fe700 1 -- 172.21.15.151:0/4019582494 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000a0d0 con 0x7f9e38067ba0 2022-03-15T05:50:24.275 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.268+0000 7f9e377fe700 1 -- 172.21.15.151:0/4019582494 <== mon.2 v2:172.21.15.164:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3000a230 con 0x7f9e38067ba0 2022-03-15T05:50:24.275 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.268+0000 7f9e377fe700 1 -- 172.21.15.151:0/4019582494 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3000cb90 con 0x7f9e38067ba0 2022-03-15T05:50:24.275 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.269+0000 7f9e3f029700 1 -- 172.21.15.151:0/4019582494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e38067ba0 msgr2=0x7f9e38151750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.275 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.269+0000 7f9e3f029700 1 --2- 172.21.15.151:0/4019582494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e38067ba0 0x7f9e38151750 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e3000afa0 tx=0x7f9e3000a890 comp rx=0 tx=0).stop 2022-03-15T05:50:24.276 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.269+0000 7f9e3f029700 1 -- 172.21.15.151:0/4019582494 shutdown_connections 2022-03-15T05:50:24.276 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.269+0000 7f9e3f029700 1 --2- 172.21.15.151:0/4019582494 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e38067ba0 0x7f9e38151750 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.276 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.269+0000 7f9e3f029700 1 -- 172.21.15.151:0/4019582494 >> 172.21.15.151:0/4019582494 conn(0x7f9e380c75c0 msgr2=0x7f9e380c35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.276 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.269+0000 7f9e3f029700 1 -- 172.21.15.151:0/4019582494 shutdown_connections 2022-03-15T05:50:24.276 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.269+0000 7f9e3f029700 1 -- 172.21.15.151:0/4019582494 wait complete. 2022-03-15T05:50:24.277 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.270+0000 7f9e3f029700 1 Processor -- start 2022-03-15T05:50:24.277 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.271+0000 7f9e3f029700 1 -- start start 2022-03-15T05:50:24.279 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3f029700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e38067ba0 0x7f9e38147860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3f029700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e380bd750 0x7f9e381655d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3f029700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e380c2220 0x7f9e38165b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3f029700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380c0310 con 0x7f9e38067ba0 2022-03-15T05:50:24.280 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3f029700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38148b10 con 0x7f9e380bd750 2022-03-15T05:50:24.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3f029700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38148df0 con 0x7f9e380c2220 2022-03-15T05:50:24.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3cdc5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e38067ba0 0x7f9e38147860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3cdc5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e38067ba0 0x7f9e38147860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60164/0 (socket says 172.21.15.151:60164) 2022-03-15T05:50:24.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/4154851043 learned_addr learned my addr 172.21.15.151:0/4154851043 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.281 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e37fff700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e380bd750 0x7f9e381655d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3d5c6700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e380c2220 0x7f9e38165b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e380c2220 msgr2=0x7f9e38165b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e380c2220 0x7f9e38165b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.282 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e380bd750 msgr2=0x7f9e381655d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e380bd750 0x7f9e381655d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/4154851043 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3000ab30 con 0x7f9e38067ba0 2022-03-15T05:50:24.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.272+0000 7f9e37fff700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e380bd750 0x7f9e381655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:50:24.283 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.273+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e38067ba0 0x7f9e38147860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00c490 tx=0x7f9e2c007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.284 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.273+0000 7f9e34ff9700 1 -- 172.21.15.151:0/4154851043 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00ce90 con 0x7f9e38067ba0 2022-03-15T05:50:24.284 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.273+0000 7f9e34ff9700 1 -- 172.21.15.151:0/4154851043 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c0050d0 con 0x7f9e38067ba0 2022-03-15T05:50:24.284 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.273+0000 7f9e3f029700 1 -- 172.21.15.151:0/4154851043 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e381490d0 con 0x7f9e38067ba0 2022-03-15T05:50:24.284 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.273+0000 7f9e34ff9700 1 -- 172.21.15.151:0/4154851043 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c011590 con 0x7f9e38067ba0 2022-03-15T05:50:24.284 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.273+0000 7f9e3f029700 1 -- 172.21.15.151:0/4154851043 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e38149690 con 0x7f9e38067ba0 2022-03-15T05:50:24.285 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.275+0000 7f9e34ff9700 1 -- 172.21.15.151:0/4154851043 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f9e2c019030 con 0x7f9e38067ba0 2022-03-15T05:50:24.285 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.276+0000 7f9e34ff9700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9e200633c0 0x7f9e20065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.285 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.276+0000 7f9e34ff9700 1 -- 172.21.15.151:0/4154851043 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9e2c07efa0 con 0x7f9e38067ba0 2022-03-15T05:50:24.285 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.276+0000 7f9e37fff700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9e200633c0 0x7f9e20065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.286 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.277+0000 7f9e37fff700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9e200633c0 0x7f9e20065870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e380c1420 tx=0x7f9e24009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.292 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.278+0000 7f9e489a2b80 1 Processor -- start 2022-03-15T05:50:24.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.278+0000 7f9e489a2b80 1 -- start start 2022-03-15T05:50:24.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.279+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46aa5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.279+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46ae55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.293 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.279+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 0x55cf46adbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.279+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf46a24540 con 0x55cf46ae6bd0 2022-03-15T05:50:24.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.279+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf469928a0 con 0x55cf46aa51c0 2022-03-15T05:50:24.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.279+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf469faae0 con 0x55cf46ae5af0 2022-03-15T05:50:24.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.279+0000 7f9e3cdc5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46aa5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.294 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e3d5c6700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 0x55cf46adbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.295 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e3cdc5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46aa5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57384/0 (socket says 172.21.15.151:57384) 2022-03-15T05:50:24.295 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/2394798177 learned_addr learned my addr 172.21.15.151:0/2394798177 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.295 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e37fff700 1 --2- 172.21.15.151:0/2394798177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46ae55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.295 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/2394798177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 msgr2=0x55cf46adbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.296 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/2394798177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 0x55cf46adbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.296 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/2394798177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 msgr2=0x55cf46ae55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.296 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/2394798177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46ae55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.296 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/2394798177 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf468ea890 con 0x55cf46aa51c0 2022-03-15T05:50:24.297 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/2394798177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46aa5ca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c001eb0 tx=0x7f9e2c051970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c7af4057e698fec1 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.297 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e19ffb700 1 -- 172.21.15.151:0/2394798177 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c057da0 con 0x55cf46aa51c0 2022-03-15T05:50:24.297 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e19ffb700 1 -- 172.21.15.151:0/2394798177 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c007e10 con 0x55cf46aa51c0 2022-03-15T05:50:24.297 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.280+0000 7f9e19ffb700 1 -- 172.21.15.151:0/2394798177 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c0510f0 con 0x55cf46aa51c0 2022-03-15T05:50:24.297 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.281+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2394798177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 msgr2=0x55cf46aa5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.298 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.281+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/2394798177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46aa5ca0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c001eb0 tx=0x7f9e2c051970 comp rx=0 tx=0).stop 2022-03-15T05:50:24.298 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.281+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2394798177 shutdown_connections 2022-03-15T05:50:24.298 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.281+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/2394798177 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 0x55cf46adbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.298 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.281+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/2394798177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46aa5ca0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.299 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.281+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/2394798177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46ae55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.299 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.281+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2394798177 >> 172.21.15.151:0/2394798177 conn(0x55cf46aa4c20 msgr2=0x55cf46aea6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.299 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.281+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2394798177 shutdown_connections 2022-03-15T05:50:24.299 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.281+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2394798177 wait complete. 2022-03-15T05:50:24.299 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.282+0000 7f9e489a2b80 1 -- start start 2022-03-15T05:50:24.300 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.282+0000 7f9e489a2b80 1 Processor -- start 2022-03-15T05:50:24.300 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.283+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46ae9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.300 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.283+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 0x55cf46af6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.300 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.283+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46ad8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.300 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.283+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf469f4bc0 con 0x55cf46ae6bd0 2022-03-15T05:50:24.301 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.283+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf468f1700 con 0x55cf46ae5af0 2022-03-15T05:50:24.301 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.283+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf46addbb0 con 0x55cf46aa51c0 2022-03-15T05:50:24.301 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.283+0000 7f9e489a2b80 10 client.0 _ll_register_callbacks cb 0x55cf4699e5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-15T05:50:24.301 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3cdc5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46ae9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.301 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3cdc5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46ae9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60288/0 (socket says 172.21.15.151:60288) 2022-03-15T05:50:24.302 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e37fff700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 0x55cf46af6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.302 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/3367490565 learned_addr learned my addr 172.21.15.151:0/3367490565 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.302 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3d5c6700 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46ad8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.302 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/3367490565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 msgr2=0x55cf46af6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.303 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 0x55cf46af6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.303 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/3367490565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 msgr2=0x55cf46ad8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.303 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46ad8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.303 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/3367490565 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e38149690 con 0x55cf46aa51c0 2022-03-15T05:50:24.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3d5c6700 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46ad8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:50:24.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46ae9990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c04ff50 tx=0x7f9e2c013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97a0823d770d855a server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e12ffd700 10 client.0 ms_handle_connect on v2:172.21.15.164:3301/0 2022-03-15T05:50:24.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e12ffd700 1 -- 172.21.15.151:0/3367490565 <== mon.2 v2:172.21.15.164:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c057aa0 con 0x55cf46aa51c0 2022-03-15T05:50:24.304 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e12ffd700 1 -- 172.21.15.151:0/3367490565 <== mon.2 v2:172.21.15.164:3301/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9e2c04d9f0 con 0x55cf46aa51c0 2022-03-15T05:50:24.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.284+0000 7f9e489a2b80 1 -- 172.21.15.151:0/3367490565 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf46a99fd0 con 0x55cf46aa51c0 2022-03-15T05:50:24.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e12ffd700 1 -- 172.21.15.151:0/3367490565 <== mon.2 v2:172.21.15.164:3301/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e2c06c270 con 0x55cf46aa51c0 2022-03-15T05:50:24.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e489a2b80 10 client.4583 fetch_fsmap learned FSMap version 12 2022-03-15T05:50:24.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e489a2b80 1 -- 172.21.15.151:0/3367490565 --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x55cf46838b10 con 0x55cf46aa51c0 2022-03-15T05:50:24.305 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e12ffd700 1 -- 172.21.15.151:0/3367490565 <== mon.2 v2:172.21.15.164:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cf46a99fd0 con 0x55cf46aa51c0 2022-03-15T05:50:24.306 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e12ffd700 1 -- 172.21.15.151:0/3367490565 <== mon.2 v2:172.21.15.164:3301/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7f9e2c06c3d0 con 0x55cf46aa51c0 2022-03-15T05:50:24.306 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e489a2b80 10 client.4583 fetch_fsmap finished waiting for FSMap version 12 2022-03-15T05:50:24.306 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e489a2b80 10 client.4583 resolve_mds: resolved name 'a' to daemon mds.a 2022-03-15T05:50:24.306 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e489a2b80 20 client.4583 populate_metadata read hostname 'smithi151' 2022-03-15T05:50:24.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.151:6833/3891906240,v1:172.21.15.151:6835/3891906240] conn(0x55cf46ae2d90 0x55cf46af99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e489a2b80 4 client.4583 mds_command: new command op to 4312 tid=0[{"prefix": "get_command_descriptions"}] 2022-03-15T05:50:24.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e489a2b80 1 -- 172.21.15.151:0/3367490565 --> [v2:172.21.15.151:6833/3891906240,v1:172.21.15.151:6835/3891906240] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf46a76690 con 0x55cf46ae2d90 2022-03-15T05:50:24.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.285+0000 7f9e37fff700 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.151:6833/3891906240,v1:172.21.15.151:6835/3891906240] conn(0x55cf46ae2d90 0x55cf46af99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.307 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.286+0000 7f9e12ffd700 10 client.4583 ms_handle_connect on v2:172.21.15.151:6833/3891906240 2022-03-15T05:50:24.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.286+0000 7f9e37fff700 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.151:6833/3891906240,v1:172.21.15.151:6835/3891906240] conn(0x55cf46ae2d90 0x55cf46af99f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed89962f91a37e05 server_cookie=505fa094aad1c177 in_seq=0 out_seq=0 2022-03-15T05:50:24.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e12ffd700 1 -- 172.21.15.151:0/3367490565 <== mds.0 v2:172.21.15.151:6833/3891906240 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17246 (crc 0 0 0) 0x55cf46a76690 con 0x55cf46ae2d90 2022-03-15T05:50:24.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e12ffd700 10 client.4583 handle_command_reply: tid=0 2022-03-15T05:50:24.308 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 client.4583 shutdown 2022-03-15T05:50:24.309 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 -- 172.21.15.151:0/3367490565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 msgr2=0x55cf46ae9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.309 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46ae9990 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c04ff50 tx=0x7f9e2c013000 comp rx=0 tx=0).stop 2022-03-15T05:50:24.309 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 -- 172.21.15.151:0/3367490565 shutdown_connections 2022-03-15T05:50:24.309 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.151:6833/3891906240,v1:172.21.15.151:6835/3891906240] conn(0x55cf46ae2d90 0x55cf46af99f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.309 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46ad8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.310 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46ae9990 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.310 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e12ffd700 0 client.4583 ms_handle_reset on v2:172.21.15.151:6833/3891906240 2022-03-15T05:50:24.310 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/3367490565 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 0x55cf46af6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.310 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 -- 172.21.15.151:0/3367490565 >> 172.21.15.151:0/3367490565 conn(0x55cf46aa4c20 msgr2=0x55cf46aa0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.311 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 -- 172.21.15.151:0/3367490565 shutdown_connections 2022-03-15T05:50:24.311 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.287+0000 7f9e489a2b80 1 -- 172.21.15.151:0/3367490565 wait complete. 2022-03-15T05:50:24.311 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.288+0000 7f9e489a2b80 20 client.4583 trim_cache size 0 max 16384 2022-03-15T05:50:24.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.305+0000 7f9e489a2b80 1 Processor -- start 2022-03-15T05:50:24.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.305+0000 7f9e489a2b80 1 -- start start 2022-03-15T05:50:24.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.306+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46adc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.319 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 0x55cf46adcd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46aa0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf46ae0cb0 con 0x55cf46ae6bd0 2022-03-15T05:50:24.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf46b09290 con 0x55cf46aa51c0 2022-03-15T05:50:24.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf46b00b60 con 0x55cf46ae5af0 2022-03-15T05:50:24.320 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3d5c6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46aa0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3cdc5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46adc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e37fff700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 0x55cf46adcd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3d5c6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46aa0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60170/0 (socket says 172.21.15.151:60170) 2022-03-15T05:50:24.321 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3cdc5700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46adc840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.151:57390/0 (socket says 172.21.15.151:57390) 2022-03-15T05:50:24.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3d5c6700 1 -- 172.21.15.151:0/1282529228 learned_addr learned my addr 172.21.15.151:0/1282529228 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/1282529228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 msgr2=0x55cf46adcd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/1282529228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 0x55cf46adcd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/1282529228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 msgr2=0x55cf46aa0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.322 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/1282529228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46aa0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/1282529228 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf4685f160 con 0x55cf46aa51c0 2022-03-15T05:50:24.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e37fff700 1 --2- 172.21.15.151:0/1282529228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 0x55cf46adcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:24.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.307+0000 7f9e3d5c6700 1 --2- 172.21.15.151:0/1282529228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46aa0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:24.323 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/1282529228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46adc840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00cb30 tx=0x7f9e2c00c070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56e9adfeb3972876 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e1a7fc700 1 -- 172.21.15.151:0/1282529228 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c04fd40 con 0x55cf46aa51c0 2022-03-15T05:50:24.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e1a7fc700 1 -- 172.21.15.151:0/1282529228 <== mon.1 v2:172.21.15.164:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c057aa0 con 0x55cf46aa51c0 2022-03-15T05:50:24.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e1a7fc700 1 -- 172.21.15.151:0/1282529228 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c051ba0 con 0x55cf46aa51c0 2022-03-15T05:50:24.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e489a2b80 1 -- 172.21.15.151:0/1282529228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 msgr2=0x55cf46adc840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.324 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/1282529228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46adc840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00cb30 tx=0x7f9e2c00c070 comp rx=0 tx=0).stop 2022-03-15T05:50:24.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e489a2b80 1 -- 172.21.15.151:0/1282529228 shutdown_connections 2022-03-15T05:50:24.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/1282529228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46aa0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/1282529228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46aa51c0 0x55cf46adc840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.325 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/1282529228 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46ae5af0 0x55cf46adcd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.326 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e489a2b80 1 -- 172.21.15.151:0/1282529228 >> 172.21.15.151:0/1282529228 conn(0x55cf46aa4c20 msgr2=0x55cf46aa3170 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.326 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.308+0000 7f9e489a2b80 1 -- 172.21.15.151:0/1282529228 shutdown_connections 2022-03-15T05:50:24.326 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.309+0000 7f9e489a2b80 1 -- 172.21.15.151:0/1282529228 wait complete. 2022-03-15T05:50:24.326 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.309+0000 7f9e489a2b80 1 -- start start 2022-03-15T05:50:24.326 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.309+0000 7f9e489a2b80 1 Processor -- start 2022-03-15T05:50:24.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.310+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46b4bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.310+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 0x55cf46af9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.310+0000 7f9e489a2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46b45810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.327 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.310+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf46add050 con 0x55cf46ae6bd0 2022-03-15T05:50:24.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.310+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf46b4c320 con 0x55cf46ae5af0 2022-03-15T05:50:24.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.310+0000 7f9e489a2b80 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cf46afa380 con 0x55cf46aa51c0 2022-03-15T05:50:24.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.310+0000 7f9e489a2b80 10 client.0 _ll_register_callbacks cb 0x55cf4699e5e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2022-03-15T05:50:24.328 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e3cdc5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46b4bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e3cdc5700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46b4bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3301/0 says I am v2:172.21.15.151:60292/0 (socket says 172.21.15.151:60292) 2022-03-15T05:50:24.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e3cdc5700 1 -- 172.21.15.151:0/2605772554 learned_addr learned my addr 172.21.15.151:0/2605772554 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e37fff700 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 0x55cf46af9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e3d5c6700 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46b45810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.329 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e37fff700 1 -- 172.21.15.151:0/2605772554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 msgr2=0x55cf46b4bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e37fff700 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46b4bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e37fff700 1 -- 172.21.15.151:0/2605772554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 msgr2=0x55cf46b45810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2022-03-15T05:50:24.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e37fff700 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46b45810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.330 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e37fff700 1 -- 172.21.15.151:0/2605772554 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2400f040 con 0x55cf46ae5af0 2022-03-15T05:50:24.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46b4bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2022-03-15T05:50:24.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e3d5c6700 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46b45810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2022-03-15T05:50:24.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e37fff700 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 0x55cf46af9a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55cf46aa4060 tx=0x7f9e24013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7140c6b062677cef server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.331 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e12ffd700 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2022-03-15T05:50:24.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.311+0000 7f9e12ffd700 1 -- 172.21.15.151:0/2605772554 <== mon.1 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240261a0 con 0x55cf46ae5af0 2022-03-15T05:50:24.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2605772554 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9e2c007e10 con 0x55cf46ae5af0 2022-03-15T05:50:24.332 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e12ffd700 1 -- 172.21.15.151:0/2605772554 <== mon.1 v2:172.21.15.164:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9e24026960 con 0x55cf46ae5af0 2022-03-15T05:50:24.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e12ffd700 1 -- 172.21.15.151:0/2605772554 <== mon.1 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9e24026d30 con 0x55cf46ae5af0 2022-03-15T05:50:24.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e489a2b80 10 client.4705 fetch_fsmap learned FSMap version 12 2022-03-15T05:50:24.333 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2605772554 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x7f9e380c2a10 con 0x55cf46ae5af0 2022-03-15T05:50:24.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e12ffd700 1 -- 172.21.15.151:0/2605772554 <== mon.1 v2:172.21.15.164:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c007e10 con 0x55cf46ae5af0 2022-03-15T05:50:24.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e12ffd700 1 -- 172.21.15.151:0/2605772554 <== mon.1 v2:172.21.15.164:3300/0 5 ==== fsmap(e 12) v1 ==== 4214+0+0 (secure 0 0 0) 0x7f9e2400e630 con 0x55cf46ae5af0 2022-03-15T05:50:24.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e489a2b80 10 client.4705 fetch_fsmap finished waiting for FSMap version 12 2022-03-15T05:50:24.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e489a2b80 10 client.4705 resolve_mds: resolved name 'a' to daemon mds.a 2022-03-15T05:50:24.334 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e489a2b80 20 client.4705 populate_metadata read hostname 'smithi151' 2022-03-15T05:50:24.335 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.151:6833/3891906240,v1:172.21.15.151:6835/3891906240] conn(0x55cf46b4f0a0 0x55cf46b4f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.335 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e489a2b80 4 client.4705 mds_command: new command op to 4312 tid=0[{"prefix": "status"}] 2022-03-15T05:50:24.335 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.312+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2605772554 --> [v2:172.21.15.151:6833/3891906240,v1:172.21.15.151:6835/3891906240] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cf4699a4a0 con 0x55cf46b4f0a0 2022-03-15T05:50:24.336 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.151:6833/3891906240,v1:172.21.15.151:6835/3891906240] conn(0x55cf46b4f0a0 0x55cf46b4f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.336 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e3cdc5700 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.151:6833/3891906240,v1:172.21.15.151:6835/3891906240] conn(0x55cf46b4f0a0 0x55cf46b4f470 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7ca9053286bf0e3 server_cookie=1944cb4381e6a795 in_seq=0 out_seq=0 2022-03-15T05:50:24.336 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e12ffd700 10 client.4705 ms_handle_connect on v2:172.21.15.151:6833/3891906240 2022-03-15T05:50:24.337 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e12ffd700 1 -- 172.21.15.151:0/2605772554 <== mds.0 v2:172.21.15.151:6833/3891906240 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55cf4699a4a0 con 0x55cf46b4f0a0 2022-03-15T05:50:24.337 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e12ffd700 10 client.4705 handle_command_reply: tid=0 2022-03-15T05:50:24.337 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e489a2b80 1 client.4705 shutdown 2022-03-15T05:50:24.337 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2605772554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 msgr2=0x55cf46af9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.338 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 0x55cf46af9a40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55cf46aa4060 tx=0x7f9e24013000 comp rx=0 tx=0).stop 2022-03-15T05:50:24.338 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2605772554 shutdown_connections 2022-03-15T05:50:24.338 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.151:6833/3891906240,v1:172.21.15.151:6835/3891906240] conn(0x55cf46b4f0a0 0x55cf46b4f470 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.338 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf46ae6bd0 0x55cf46b45810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.339 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x55cf46aa51c0 0x55cf46b4bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.339 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e489a2b80 1 --2- 172.21.15.151:0/2605772554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55cf46ae5af0 0x55cf46af9a40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.339 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.314+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2605772554 >> 172.21.15.151:0/2605772554 conn(0x55cf46aa4c20 msgr2=0x55cf46aa8400 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.339 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.313+0000 7f9e12ffd700 0 client.4705 ms_handle_reset on v2:172.21.15.151:6833/3891906240 2022-03-15T05:50:24.340 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.314+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2605772554 shutdown_connections 2022-03-15T05:50:24.340 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.314+0000 7f9e489a2b80 1 -- 172.21.15.151:0/2605772554 wait complete. 2022-03-15T05:50:24.340 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.314+0000 7f9e489a2b80 20 client.4705 trim_cache size 0 max 16384 2022-03-15T05:50:24.341 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2022-03-15T05:50:24.341 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c", 2022-03-15T05:50:24.341 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 0, 2022-03-15T05:50:24.342 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 4312, 2022-03-15T05:50:24.342 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2022-03-15T05:50:24.342 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2022-03-15T05:50:24.342 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2022-03-15T05:50:24.343 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 22.061688753999999, 2022-03-15T05:50:24.343 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 12, 2022-03-15T05:50:24.343 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 24, 2022-03-15T05:50:24.343 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 24, 2022-03-15T05:50:24.344 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 28.383219350000001 2022-03-15T05:50:24.344 INFO:teuthology.orchestra.run.smithi151.stdout:} 2022-03-15T05:50:24.345 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.314+0000 7f9e3f029700 1 -- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9e200633c0 msgr2=0x7f9e20065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.346 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.314+0000 7f9e3f029700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9e200633c0 0x7f9e20065870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9e380c1420 tx=0x7f9e24009040 comp rx=0 tx=0).stop 2022-03-15T05:50:24.346 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.314+0000 7f9e3f029700 1 -- 172.21.15.151:0/4154851043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e38067ba0 msgr2=0x7f9e38147860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.346 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.314+0000 7f9e3f029700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e38067ba0 0x7f9e38147860 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c00c490 tx=0x7f9e2c007cd0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.346 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.315+0000 7f9e3f029700 1 -- 172.21.15.151:0/4154851043 shutdown_connections 2022-03-15T05:50:24.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.315+0000 7f9e3f029700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f9e200633c0 0x7f9e20065870 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.315+0000 7f9e3f029700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f9e380c2220 0x7f9e38165b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.315+0000 7f9e3f029700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9e38067ba0 0x7f9e38147860 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.347 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.315+0000 7f9e3f029700 1 --2- 172.21.15.151:0/4154851043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e380bd750 0x7f9e381655d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.348 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.315+0000 7f9e3f029700 1 -- 172.21.15.151:0/4154851043 >> 172.21.15.151:0/4154851043 conn(0x7f9e380c75c0 msgr2=0x7f9e380c4960 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.348 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.315+0000 7f9e3f029700 1 -- 172.21.15.151:0/4154851043 shutdown_connections 2022-03-15T05:50:24.348 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.315+0000 7f9e3f029700 1 -- 172.21.15.151:0/4154851043 wait complete. 2022-03-15T05:50:24.348 INFO:teuthology.run_tasks:Running task kclient... 2022-03-15T05:50:24.370 INFO:tasks.kclient:Mounting kernel clients... 2022-03-15T05:50:24.371 INFO:tasks.kclient:config is {'client.0': {}} 2022-03-15T05:50:24.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:24.372 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2022-03-15T05:50:24.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:24.427 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2022-03-15T05:50:24.511 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2022-03-15T05:50:24.515 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-03-15T05:50:24.515 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2022-03-15T05:50:24.516 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2022-03-15T05:50:24.724 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.722+0000 7f3b5c89a700 1 Processor -- start 2022-03-15T05:50:24.724 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.722+0000 7f3b5c89a700 1 -- start start 2022-03-15T05:50:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.723+0000 7f3b5c89a700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3b58155340 0x7f3b580c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.726 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.723+0000 7f3b5c89a700 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b58158560 con 0x7f3b580c56e0 2022-03-15T05:50:24.727 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.723+0000 7f3b5c89a700 1 -- --> v1:172.21.15.164:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b58158840 con 0x7f3b580c2b30 2022-03-15T05:50:24.727 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.723+0000 7f3b5c89a700 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b58158b20 con 0x7f3b58155340 2022-03-15T05:50:24.727 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.724+0000 7f3b5759e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3b58155340 0x7f3b580c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.727 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.724+0000 7f3b5759e700 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3b58155340 0x7f3b580c2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60174/0 (socket says 172.21.15.151:60174) 2022-03-15T05:50:24.727 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.724+0000 7f3b5759e700 1 -- 172.21.15.151:0/1357571989 learned_addr learned my addr 172.21.15.151:0/1357571989 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.724+0000 7f3b56d9d700 1 --1- 172.21.15.151:0/1357571989 >> v1:172.21.15.164:6789/0 conn(0x7f3b580c2b30 0x7f3b58157d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.164:6789/0 says I am v1:172.21.15.151:33700/0 (socket says 172.21.15.151:33700) 2022-03-15T05:50:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.724+0000 7f3b5659c700 1 --1- 172.21.15.151:0/1357571989 >> v1:172.21.15.151:6789/0 conn(0x7f3b580c56e0 0x7f3b580c4610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:53244/0 (socket says 172.21.15.151:53244) 2022-03-15T05:50:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.724+0000 7f3b5759e700 1 -- 172.21.15.151:0/1357571989 >> v1:172.21.15.164:6789/0 conn(0x7f3b580c2b30 legacy=0x7f3b58157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.728 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.724+0000 7f3b5759e700 1 -- 172.21.15.151:0/1357571989 >> v1:172.21.15.151:6789/0 conn(0x7f3b580c56e0 legacy=0x7f3b580c4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.729 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.724+0000 7f3b55d9b700 1 -- 172.21.15.151:0/1357571989 <== mon.1 v1:172.21.15.164:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631106374 0 0) 0x7f3b58158840 con 0x7f3b580c2b30 2022-03-15T05:50:24.729 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.724+0000 7f3b5759e700 1 -- 172.21.15.151:0/1357571989 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b58154860 con 0x7f3b58155340 2022-03-15T05:50:24.729 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.724+0000 7f3b5759e700 1 --2- 172.21.15.151:0/1357571989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 0x7f3b580c2050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009f20 tx=0x7f3b50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7388ef8af82b1def server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.732 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.725+0000 7f3b55d9b700 1 -- 172.21.15.151:0/1357571989 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000e070 con 0x7f3b58155340 2022-03-15T05:50:24.733 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.725+0000 7f3b55d9b700 1 -- 172.21.15.151:0/1357571989 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5000ba80 con 0x7f3b58155340 2022-03-15T05:50:24.733 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.725+0000 7f3b55d9b700 1 -- 172.21.15.151:0/1357571989 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5000be00 con 0x7f3b58155340 2022-03-15T05:50:24.733 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.725+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1357571989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 msgr2=0x7f3b580c2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.733 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.725+0000 7f3b5c89a700 1 --2- 172.21.15.151:0/1357571989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 0x7f3b580c2050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009f20 tx=0x7f3b50009840 comp rx=0 tx=0).stop 2022-03-15T05:50:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.725+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1357571989 shutdown_connections 2022-03-15T05:50:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.725+0000 7f3b5c89a700 1 --2- 172.21.15.151:0/1357571989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 0x7f3b580c2050 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.725+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1357571989 >> 172.21.15.151:0/1357571989 conn(0x7f3b580cae10 msgr2=0x7f3b580cb210 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.734 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.725+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1357571989 shutdown_connections 2022-03-15T05:50:24.735 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.725+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1357571989 wait complete. 2022-03-15T05:50:24.735 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.728+0000 7f3b5c89a700 1 Processor -- start 2022-03-15T05:50:24.735 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.728+0000 7f3b5c89a700 1 -- start start 2022-03-15T05:50:24.735 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.729+0000 7f3b5c89a700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b580c2b30 0x7f3b580a85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.736 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.729+0000 7f3b5c89a700 1 --2- >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b580c56e0 0x7f3b580a94c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.736 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.729+0000 7f3b5c89a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 0x7f3b581685f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.736 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.729+0000 7f3b5c89a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b58164df0 con 0x7f3b58155340 2022-03-15T05:50:24.736 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.729+0000 7f3b5c89a700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580a9210 con 0x7f3b580c2b30 2022-03-15T05:50:24.736 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.729+0000 7f3b5c89a700 1 -- --> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b580a8c50 con 0x7f3b580c56e0 2022-03-15T05:50:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.729+0000 7f3b5759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 0x7f3b581685f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.729+0000 7f3b56d9d700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b580c2b30 0x7f3b580a85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.729+0000 7f3b5759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 0x7f3b581685f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60176/0 (socket says 172.21.15.151:60176) 2022-03-15T05:50:24.737 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.729+0000 7f3b5759e700 1 -- 172.21.15.151:0/1326425855 learned_addr learned my addr 172.21.15.151:0/1326425855 (peer_addr_for_me v2:172.21.15.151:0/0) 2022-03-15T05:50:24.738 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.730+0000 7f3b5659c700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b580c56e0 0x7f3b580a94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.738 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.730+0000 7f3b5759e700 1 -- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b580c56e0 msgr2=0x7f3b580a94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.738 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.730+0000 7f3b5759e700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b580c56e0 0x7f3b580a94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.738 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.730+0000 7f3b5759e700 1 -- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b580c2b30 msgr2=0x7f3b580a85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.739 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.730+0000 7f3b5759e700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b580c2b30 0x7f3b580a85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.739 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.730+0000 7f3b5759e700 1 -- 172.21.15.151:0/1326425855 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50009ae0 con 0x7f3b58155340 2022-03-15T05:50:24.739 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.730+0000 7f3b5759e700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 0x7f3b581685f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3b58088790 tx=0x7f3b50018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.739 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.730+0000 7f3b3effd700 1 -- 172.21.15.151:0/1326425855 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50007610 con 0x7f3b58155340 2022-03-15T05:50:24.739 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.731+0000 7f3b3effd700 1 -- 172.21.15.151:0/1326425855 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b50007770 con 0x7f3b58155340 2022-03-15T05:50:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.731+0000 7f3b3effd700 1 -- 172.21.15.151:0/1326425855 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50007b30 con 0x7f3b58155340 2022-03-15T05:50:24.740 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.731+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1326425855 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b580a8f30 con 0x7f3b58155340 2022-03-15T05:50:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.731+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1326425855 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b58164a80 con 0x7f3b58155340 2022-03-15T05:50:24.741 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.732+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1326425855 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b58164c40 con 0x7f3b58155340 2022-03-15T05:50:24.742 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.732+0000 7f3b3effd700 1 -- 172.21.15.151:0/1326425855 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 81330+0+0 (secure 0 0 0) 0x7f3b50004040 con 0x7f3b58155340 2022-03-15T05:50:24.742 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.733+0000 7f3b3effd700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3b380633c0 0x7f3b38065870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2022-03-15T05:50:24.742 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.733+0000 7f3b3effd700 1 -- 172.21.15.151:0/1326425855 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3b50081c90 con 0x7f3b58155340 2022-03-15T05:50:24.742 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.734+0000 7f3b56d9d700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3b380633c0 0x7f3b38065870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2022-03-15T05:50:24.743 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.734+0000 7f3b56d9d700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3b380633c0 0x7f3b38065870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b48007fd0 tx=0x7f3b48007d10 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2022-03-15T05:50:24.743 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.738+0000 7f3b3effd700 1 -- 172.21.15.151:0/1326425855 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+162475 (secure 0 0 0) 0x7f3b50050c30 con 0x7f3b58155340 2022-03-15T05:50:24.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:50:24.917 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:50:24.967 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.965+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1326425855 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3b580637b0 con 0x7f3b58155340 2022-03-15T05:50:24.968 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.966+0000 7f3b3effd700 1 -- 172.21.15.151:0/1326425855 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3b5002a020 con 0x7f3b58155340 2022-03-15T05:50:24.969 INFO:teuthology.orchestra.run.smithi151.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2022-03-15T05:50:24.971 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3b380633c0 msgr2=0x7f3b38065870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.971 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3b380633c0 0x7f3b38065870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3b48007fd0 tx=0x7f3b48007d10 comp rx=0 tx=0).stop 2022-03-15T05:50:24.972 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1326425855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 msgr2=0x7f3b581685f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2022-03-15T05:50:24.972 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 0x7f3b581685f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3b58088790 tx=0x7f3b50018000 comp rx=0 tx=0).stop 2022-03-15T05:50:24.972 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1326425855 shutdown_connections 2022-03-15T05:50:24.972 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:6832/40466,v1:172.21.15.164:6833/40466] conn(0x7f3b380633c0 0x7f3b38065870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.973 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b58155340 0x7f3b581685f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.973 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b580c2b30 0x7f3b580a85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.973 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 --2- 172.21.15.151:0/1326425855 >> [v2:172.21.15.164:3301/0,v1:172.21.15.164:6790/0] conn(0x7f3b580c56e0 0x7f3b580a94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2022-03-15T05:50:24.973 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1326425855 >> 172.21.15.151:0/1326425855 conn(0x7f3b580cae10 msgr2=0x7f3b581525f0 unknown :-1 s=STATE_NONE l=0).mark_down 2022-03-15T05:50:24.973 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1326425855 shutdown_connections 2022-03-15T05:50:24.974 INFO:teuthology.orchestra.run.smithi151.stderr:2022-03-15T05:50:24.969+0000 7f3b5c89a700 1 -- 172.21.15.151:0/1326425855 wait complete. 2022-03-15T05:50:24.996 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2022-03-15T05:50:24.996 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2022-03-15T05:50:24.997 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2022-03-15T05:50:24.997 INFO:tasks.cephfs.mount:self.client.name = client.0 2022-03-15T05:50:24.997 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2022-03-15T05:50:24.997 INFO:tasks.cephfs.mount:self.cephfs_name = None 2022-03-15T05:50:24.998 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2022-03-15T05:50:24.998 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2022-03-15T05:50:24.998 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2022-03-15T05:50:24.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:24.999 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2022-03-15T05:50:25.053 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2022-03-15T05:50:25.053 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2022-03-15T05:50:25.053 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2022-03-15T05:50:25.054 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2022-03-15T05:50:25.054 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2022-03-15T05:50:25.054 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2022-03-15T05:50:25.055 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-03-15T05:50:25.055 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2022-03-15T05:50:25.055 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-03-15T05:50:25.055 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2022-03-15T05:50:25.055 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2022-03-15T05:50:25.056 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2022-03-15T05:50:25.056 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2022-03-15T05:50:25.056 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2022-03-15T05:50:25.056 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2022-03-15T05:50:25.057 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42586sec preferred_lft 42586sec 2022-03-15T05:50:25.057 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2022-03-15T05:50:25.057 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2022-03-15T05:50:25.058 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2022-03-15T05:50:25.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:25.059 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2022-03-15T05:50:25.060 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2022-03-15T05:50:25.060 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2022-03-15T05:50:25.060 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2022-03-15T05:50:25.061 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2022-03-15T05:50:25.061 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2022-03-15T05:50:25.061 DEBUG:teuthology.orchestra.run.smithi151:> ') 2022-03-15T05:50:25.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:25.502 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2022-03-15T05:50:25.634 INFO:teuthology.orchestra.run.smithi151.stdout:1 2022-03-15T05:50:25.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:25.639 DEBUG:teuthology.orchestra.run.smithi151:> route 2022-03-15T05:50:25.724 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2022-03-15T05:50:25.725 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2022-03-15T05:50:25.725 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2022-03-15T05:50:25.726 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2022-03-15T05:50:25.726 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2022-03-15T05:50:25.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:25.728 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2022-03-15T05:50:25.728 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2022-03-15T05:50:25.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2022-03-15T05:50:25.729 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2022-03-15T05:50:25.729 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2022-03-15T05:50:25.729 DEBUG:teuthology.orchestra.run.smithi151:> ') 2022-03-15T05:50:26.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:26.447 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2022-03-15T05:50:26.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:26.502 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2022-03-15T05:50:26.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:26.557 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2022-03-15T05:50:26.557 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2022-03-15T05:50:26.557 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2022-03-15T05:50:26.558 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2022-03-15T05:50:26.558 DEBUG:teuthology.orchestra.run.smithi151:> ') 2022-03-15T05:50:26.725 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2022-03-15T05:50:26.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:26.726 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2022-03-15T05:50:26.726 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2022-03-15T05:50:26.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2022-03-15T05:50:26.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2022-03-15T05:50:26.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2022-03-15T05:50:26.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2022-03-15T05:50:26.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2022-03-15T05:50:26.728 DEBUG:teuthology.orchestra.run.smithi151:> ') 2022-03-15T05:50:27.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:27.030 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2022-03-15T05:50:27.030 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2022-03-15T05:50:27.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2022-03-15T05:50:27.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2022-03-15T05:50:27.031 DEBUG:teuthology.orchestra.run.smithi151:> ') 2022-03-15T05:50:27.230 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-03-15T05:50:27.230 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2022-03-15T05:50:27.284 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2022-03-15T05:50:27.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2022-03-15T05:50:27.285 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2022-03-15T05:50:27.338 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2022-03-15T05:50:27.338 INFO:teuthology.orchestra.run:Running command with timeout 1800 2022-03-15T05:50:27.339 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-03-15T05:50:27.454 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-03-15T05:50:27.454 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2022-03-15T05:50:27.455 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2022-03-15T05:50:27.911 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2022-03-15T05:50:27.911 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2022-03-15T05:50:27.911 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2022-03-15T05:50:27.912 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.151:6789,172.21.15.164:6789,172.21.15.164:6790:/ 2022-03-15T05:50:27.912 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=9dcb6699-27ad-4ba7-b9a1-70c5e0ad2c4c" will pass to kernel 2022-03-15T05:50:27.919 INFO:tasks.cephfs.kernel_mount:mount command passed 2022-03-15T05:50:27.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2022-03-15T05:50:27.920 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2022-03-15T05:50:55.050 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:50:55.057 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:51:25.194 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:51:25.201 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:51:55.349 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:51:55.356 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:52:25.489 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:52:25.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:52:56.940 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:52:56.946 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:53:27.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:53:27.101 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:53:57.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:53:57.257 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:54:27.426 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:54:27.432 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:54:58.579 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:54:58.586 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:55:27.928 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2022-03-15T05:55:27.930 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_fbfc7b381c1d662565abb9d3552d468766bf123c/virtualenv/lib/python3.6/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2022-03-15T05:55:28.736 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:55:28.742 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:55:58.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:55:58.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:55:59.046 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T05:55:59.043+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43876) UID: 0 2022-03-15T05:55:59.046 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T05:55:59.044+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43876) UID: 0 2022-03-15T05:55:59.047 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T05:55:59.044+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 43876) UID: 0 2022-03-15T05:58:15.547 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:58:15.554 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:58:45.704 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:58:45.711 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:59:15.838 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:59:15.843 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:59:50.302 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T05:59:50.308 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:00:20.441 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:00:20.448 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:00:50.589 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:00:50.598 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:01:20.737 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:01:20.744 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:01:20.880 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:01:20.877+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44245) UID: 0 2022-03-15T06:01:20.880 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:01:20.877+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44245) UID: 0 2022-03-15T06:01:20.881 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:01:20.877+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44245) UID: 0 2022-03-15T06:03:31.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:03:31.782 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:04:01.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:04:01.921 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:04:32.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:04:32.103 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:05:07.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:05:07.134 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:05:37.274 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:05:37.280 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:06:07.412 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:06:07.418 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:06:37.561 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:06:37.567 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:06:37.945 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:06:37.943+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44436) UID: 0 2022-03-15T06:06:37.946 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:06:37.943+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44436) UID: 0 2022-03-15T06:06:37.947 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:06:37.943+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44436) UID: 0 2022-03-15T06:08:47.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:08:47.437 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:09:17.581 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:09:17.587 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:09:47.738 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:09:47.744 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:10:19.034 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:10:19.041 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:10:49.183 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:10:49.188 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:11:19.330 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:11:19.336 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:11:51.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:11:51.185 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:12:21.328 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:12:21.334 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:12:21.479 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:12:21.477+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44660) UID: 0 2022-03-15T06:12:21.480 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:12:21.477+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44660) UID: 0 2022-03-15T06:12:21.481 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:12:21.477+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44660) UID: 0 2022-03-15T06:14:39.318 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:14:39.325 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:15:09.472 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:15:09.479 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:15:39.652 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:15:39.657 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:16:10.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:16:10.918 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:16:41.071 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:16:41.085 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:16:41.224 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:16:41.221+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44809) UID: 0 2022-03-15T06:16:41.224 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:16:41.221+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44809) UID: 0 2022-03-15T06:16:41.225 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:16:41.221+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44809) UID: 0 2022-03-15T06:18:43.949 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:18:43.958 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:18:44.085 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:18:44.081+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44850) UID: 0 2022-03-15T06:18:44.086 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:18:44.081+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44850) UID: 0 2022-03-15T06:18:44.086 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:18:44.081+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 44850) UID: 0 2022-03-15T06:21:20.753 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:21:20.759 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:21:20.828 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T06:21:20.825+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48029) UID: 0 2022-03-15T06:21:20.829 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T06:21:20.825+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48029) UID: 0 2022-03-15T06:21:20.829 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T06:21:20.825+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48029) UID: 0 2022-03-15T06:22:56.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:22:56.784 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:23:26.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:23:26.938 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:23:57.078 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:23:57.083 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:24:28.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:24:28.507 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:24:28.640 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:24:28.637+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45010) UID: 0 2022-03-15T06:24:28.641 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:24:28.637+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45010) UID: 0 2022-03-15T06:24:28.642 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:24:28.637+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45010) UID: 0 2022-03-15T06:26:45.984 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:26:45.991 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:27:16.366 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:27:16.373 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:27:46.517 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:27:46.523 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:28:17.981 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:28:17.987 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:28:48.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:28:48.136 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:29:18.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:29:18.460 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:29:49.891 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:29:49.897 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:29:50.028 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:29:50.023+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45201) UID: 0 2022-03-15T06:29:50.028 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:29:50.023+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45201) UID: 0 2022-03-15T06:29:50.029 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:29:50.023+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45201) UID: 0 2022-03-15T06:32:00.568 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:32:00.583 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:32:30.735 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:32:30.743 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:33:01.110 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:33:01.117 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:33:31.265 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:33:31.272 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:34:01.412 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:34:01.418 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:34:31.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:34:31.565 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:35:02.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:35:02.989 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:35:33.151 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:35:33.157 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:35:33.288 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:35:33.286+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45427) UID: 0 2022-03-15T06:35:33.289 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:35:33.286+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45427) UID: 0 2022-03-15T06:35:33.289 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:35:33.286+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45427) UID: 0 2022-03-15T06:37:50.797 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:37:50.837 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:38:21.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:38:21.014 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:38:52.264 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:38:52.271 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:39:22.550 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:39:22.558 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:39:53.634 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:39:53.640 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:40:23.780 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:40:23.786 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:40:53.937 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:40:53.945 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:40:54.080 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:40:54.076+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45623) UID: 0 2022-03-15T06:40:54.081 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:40:54.076+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45623) UID: 0 2022-03-15T06:40:54.081 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:40:54.076+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45623) UID: 0 2022-03-15T06:43:04.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:43:04.472 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:43:04.628 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:43:04.625+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45665) UID: 0 2022-03-15T06:43:04.629 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:43:04.625+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45665) UID: 0 2022-03-15T06:43:04.629 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:43:04.625+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45665) UID: 0 2022-03-15T06:45:06.380 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:45:06.387 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:45:37.619 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:45:37.626 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:46:07.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:46:07.799 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:46:37.929 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:46:37.936 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:46:38.068 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:46:38.064+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45784) UID: 0 2022-03-15T06:46:38.068 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:46:38.065+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45784) UID: 0 2022-03-15T06:46:38.069 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:46:38.065+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45784) UID: 0 2022-03-15T06:48:54.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:48:54.710 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:49:24.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:49:24.899 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:49:55.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:49:55.055 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:50:25.187 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:50:25.193 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:50:55.336 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:50:55.343 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:51:25.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:51:25.529 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:51:56.481 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:51:56.487 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:51:56.523 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T06:51:56.520+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49098) UID: 0 2022-03-15T06:51:56.524 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T06:51:56.520+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49098) UID: 0 2022-03-15T06:51:56.524 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T06:51:56.520+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49098) UID: 0 2022-03-15T06:51:56.617 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:51:56.612+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45979) UID: 0 2022-03-15T06:51:56.617 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:51:56.613+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45979) UID: 0 2022-03-15T06:51:56.618 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:51:56.613+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 45979) UID: 0 2022-03-15T06:54:07.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:54:07.555 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:54:37.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:54:37.726 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:55:08.400 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:55:08.406 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:55:38.743 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:55:38.749 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:56:08.905 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:56:08.910 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:56:39.053 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:56:39.064 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:57:09.203 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:57:09.209 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:57:40.476 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:57:40.483 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:57:40.614 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T06:57:40.610+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46201) UID: 0 2022-03-15T06:57:40.718 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T06:57:40.610+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46201) UID: 0 2022-03-15T06:57:40.719 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T06:57:40.611+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46201) UID: 0 2022-03-15T06:59:58.635 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T06:59:58.641 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:00:28.805 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:00:28.812 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:00:58.974 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:00:58.980 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:01:30.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:01:30.208 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:02:00.347 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:02:00.354 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:02:30.505 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:02:30.510 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:03:01.967 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:03:01.973 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:03:02.108 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:03:02.104+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46408) UID: 0 2022-03-15T07:03:02.109 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:03:02.104+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46408) UID: 0 2022-03-15T07:03:02.109 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:03:02.104+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46408) UID: 0 2022-03-15T07:04:51.735 INFO:tasks.ceph.mds.a.smithi151.stderr:tcmalloc: large alloc 1677721600 bytes == 0x55b6049a8000 @ 0x7f18ea0e9760 0x7f18ea10ac64 0x55b59d34e3fd 0x55b59d349806 0x55b59d1df039 0x55b59d1d2b78 0x55b59d0388ca 0x55b59d0834fb 0x55b59d12c5ec 0x55b59d2fbf43 0x55b59d31dfd7 0x55b59d1c81f6 0x55b59d1cd5fa 0x55b59d1d6dda 0x55b59d1dae04 0x55b59cfd91a4 0x55b59cfdbddb 0x55b59cfdc3fc 0x55b59cfcb2f8 0x7f18e97c3dca 0x7f18e987b0f1 0x7f18e851217f 0x7f18e6f66d83 2022-03-15T07:05:12.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:05:12.509 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:05:42.858 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:05:42.865 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:06:13.587 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:06:13.593 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:06:43.726 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:06:43.732 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:07:13.889 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:07:13.895 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:07:44.046 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:07:44.051 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:08:15.436 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:08:15.442 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:08:45.624 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:08:45.631 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:08:45.765 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:08:45.762+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46628) UID: 0 2022-03-15T07:08:45.766 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:08:45.762+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46628) UID: 0 2022-03-15T07:08:45.766 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:08:45.762+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46628) UID: 0 2022-03-15T07:11:02.576 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:11:02.582 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:11:02.901 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:11:02.898+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46674) UID: 0 2022-03-15T07:11:02.902 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:11:02.898+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46674) UID: 0 2022-03-15T07:11:02.902 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:11:02.898+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46674) UID: 0 2022-03-15T07:13:11.034 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:13:11.042 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:13:41.188 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:13:41.194 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:14:11.461 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:14:11.466 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:14:11.597 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:14:11.593+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46772) UID: 0 2022-03-15T07:14:11.597 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:14:11.593+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46772) UID: 0 2022-03-15T07:14:11.598 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:14:11.593+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46772) UID: 0 2022-03-15T07:16:21.944 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:16:21.952 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:16:52.151 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:16:52.156 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:17:23.496 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:17:23.502 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:17:53.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:17:53.728 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:18:23.881 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:18:23.887 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:18:54.029 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:18:54.035 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:19:25.435 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:19:25.441 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:19:55.591 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:19:55.598 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:19:55.731 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:19:55.728+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46984) UID: 0 2022-03-15T07:19:55.731 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:19:55.728+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46984) UID: 0 2022-03-15T07:19:55.732 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:19:55.729+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46984) UID: 0 2022-03-15T07:22:13.954 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:22:13.961 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:22:44.146 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:22:44.152 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:22:44.189 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T07:22:44.187+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50152) UID: 0 2022-03-15T07:22:44.190 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T07:22:44.187+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50152) UID: 0 2022-03-15T07:22:44.190 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T07:22:44.187+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50152) UID: 0 2022-03-15T07:24:20.131 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:24:20.139 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:24:50.360 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:24:50.365 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:25:21.722 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:25:21.728 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:25:21.863 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:25:21.860+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47145) UID: 0 2022-03-15T07:25:21.864 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:25:21.860+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47145) UID: 0 2022-03-15T07:25:21.865 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:25:21.860+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47145) UID: 0 2022-03-15T07:27:34.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:27:34.546 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:28:04.773 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:28:04.780 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:28:34.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:28:34.928 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:29:06.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:29:06.151 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:29:36.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:29:36.454 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:30:06.589 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:30:06.595 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:30:37.987 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:30:37.994 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:31:08.142 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:31:08.148 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:31:08.287 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:31:08.283+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47361) UID: 0 2022-03-15T07:31:08.287 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:31:08.283+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47361) UID: 0 2022-03-15T07:31:08.288 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:31:08.284+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47361) UID: 0 2022-03-15T07:33:26.692 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:33:26.699 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:33:56.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:33:56.860 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:34:27.001 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:34:27.008 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:34:57.244 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:34:57.250 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:35:27.378 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:35:27.384 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:35:57.594 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:35:57.601 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:36:27.732 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:36:27.738 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:36:28.122 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:36:28.119+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47560) UID: 0 2022-03-15T07:36:28.123 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:36:28.119+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47560) UID: 0 2022-03-15T07:36:28.123 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:36:28.119+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47560) UID: 0 2022-03-15T07:38:41.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:38:41.958 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:38:42.123 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:38:42.121+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47600) UID: 0 2022-03-15T07:38:42.124 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:38:42.121+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47600) UID: 0 2022-03-15T07:38:42.124 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:38:42.121+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47600) UID: 0 2022-03-15T07:40:49.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:40:49.850 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:41:20.185 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:41:20.191 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:41:51.170 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:41:51.176 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:41:51.313 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:41:51.310+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47695) UID: 0 2022-03-15T07:41:51.313 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:41:51.311+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47695) UID: 0 2022-03-15T07:41:51.314 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:41:51.311+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47695) UID: 0 2022-03-15T07:44:02.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:44:02.382 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:44:32.696 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:44:32.702 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:45:03.681 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:45:03.688 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:45:34.000 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:45:34.006 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:46:04.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:46:04.206 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:46:35.459 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:46:35.465 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:47:10.246 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:47:10.253 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:47:10.384 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:47:10.382+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47886) UID: 0 2022-03-15T07:47:10.385 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:47:10.382+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47886) UID: 0 2022-03-15T07:47:10.385 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:47:10.382+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47886) UID: 0 2022-03-15T07:49:20.791 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:49:20.798 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:49:50.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:49:50.956 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:50:21.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:50:21.630 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:50:51.906 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:50:51.914 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:51:22.054 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:51:22.060 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:51:52.232 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:51:52.238 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:52:23.506 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:52:23.512 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:52:53.702 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:52:53.708 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:52:53.837 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:52:53.835+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48110) UID: 0 2022-03-15T07:52:53.838 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:52:53.835+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48110) UID: 0 2022-03-15T07:52:53.838 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:52:53.835+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48110) UID: 0 2022-03-15T07:55:16.070 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:55:16.077 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:55:16.123 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T07:55:16.120+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51394) UID: 0 2022-03-15T07:55:16.123 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T07:55:16.120+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51394) UID: 0 2022-03-15T07:55:16.124 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T07:55:16.120+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51394) UID: 0 2022-03-15T07:56:55.236 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:56:55.242 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:57:25.625 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:57:25.631 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:57:55.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:57:55.789 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:58:25.930 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:58:25.938 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T07:58:26.083 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T07:58:26.081+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48438) UID: 0 2022-03-15T07:58:26.084 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T07:58:26.081+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48438) UID: 0 2022-03-15T07:58:26.084 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T07:58:26.081+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48438) UID: 0 2022-03-15T08:00:39.643 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:00:39.650 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:01:09.819 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:01:09.826 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:01:40.942 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:01:40.949 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:02:11.098 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:02:11.105 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:02:41.236 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:02:41.242 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:03:11.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:03:11.422 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:03:42.556 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:03:42.562 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:03:42.696 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:03:42.693+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48643) UID: 0 2022-03-15T08:03:42.697 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:03:42.693+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48643) UID: 0 2022-03-15T08:03:42.698 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:03:42.693+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48643) UID: 0 2022-03-15T08:05:52.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:05:52.355 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:05:52.544 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:05:52.542+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48683) UID: 0 2022-03-15T08:05:52.544 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:05:52.542+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48683) UID: 0 2022-03-15T08:05:52.545 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:05:52.542+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48683) UID: 0 2022-03-15T08:07:58.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:07:58.055 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:08:28.184 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:08:28.190 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:08:59.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:08:59.297 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:09:29.438 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:09:29.445 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:09:29.572 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:09:29.569+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48803) UID: 0 2022-03-15T08:09:29.573 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:09:29.569+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48803) UID: 0 2022-03-15T08:09:29.574 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:09:29.569+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48803) UID: 0 2022-03-15T08:11:46.898 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:11:46.905 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:12:17.058 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:12:17.064 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:12:48.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:12:48.321 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:13:18.559 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:13:18.565 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:13:50.083 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:13:50.089 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:14:20.220 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:14:20.227 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:14:50.360 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:14:50.366 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:14:50.730 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:14:50.729+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48998) UID: 0 2022-03-15T08:14:50.731 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:14:50.729+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48998) UID: 0 2022-03-15T08:14:50.732 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:14:50.729+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 48998) UID: 0 2022-03-15T08:17:01.580 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:17:01.587 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:17:31.749 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:17:31.754 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:18:02.937 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:18:02.944 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:18:33.078 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:18:33.084 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:19:03.223 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:19:03.230 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:19:27.659 INFO:tasks.ceph.mds.a.smithi151.stderr:tcmalloc: large alloc 3355443200 bytes == 0x55b6691a8000 @ 0x7f18ea0e9760 0x7f18ea10ac64 0x55b59d34e3fd 0x55b59d349806 0x55b59d1df039 0x55b59d1d2b78 0x55b59d0388ca 0x55b59d0834fb 0x55b59d12c5ec 0x55b59d2fbf43 0x55b59d31dfd7 0x55b59d1c81f6 0x55b59d1cd5fa 0x55b59d1d6dda 0x55b59d1dae04 0x55b59cfd91a4 0x55b59cfdbddb 0x55b59cfdc3fc 0x55b59cfcb2f8 0x7f18e97c3dca 0x7f18e987b0f1 0x7f18e851217f 0x7f18e6f66d83 2022-03-15T08:19:33.378 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:19:33.383 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:20:04.601 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:20:04.608 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:20:34.757 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:20:34.764 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:20:34.895 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:20:34.893+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49222) UID: 0 2022-03-15T08:20:34.895 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:20:34.893+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49222) UID: 0 2022-03-15T08:20:34.896 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:20:34.893+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49222) UID: 0 2022-03-15T08:22:52.166 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:22:52.174 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:23:22.335 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:23:22.342 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:23:52.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:23:52.504 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:24:22.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:24:22.652 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:24:52.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:24:52.801 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:25:22.949 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:25:22.954 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:25:53.088 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:25:53.095 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:25:53.131 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T08:25:53.130+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52470) UID: 0 2022-03-15T08:25:53.132 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T08:25:53.130+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52470) UID: 0 2022-03-15T08:25:53.132 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T08:25:53.130+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52470) UID: 0 2022-03-15T08:25:53.197 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:25:53.195+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49413) UID: 0 2022-03-15T08:25:53.197 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:25:53.196+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49413) UID: 0 2022-03-15T08:25:53.198 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:25:53.196+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49413) UID: 0 2022-03-15T08:28:05.146 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:28:05.153 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:28:35.310 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:28:35.317 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:29:05.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:29:05.469 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:29:36.703 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:29:36.710 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:30:07.049 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:30:07.057 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:30:37.189 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:30:37.194 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:31:08.612 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:31:08.618 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:31:38.758 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:31:38.765 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:31:38.893 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:31:38.891+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49638) UID: 0 2022-03-15T08:31:38.893 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:31:38.891+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49638) UID: 0 2022-03-15T08:31:38.894 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:31:38.892+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49638) UID: 0 2022-03-15T08:33:58.001 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:33:58.009 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:33:58.196 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:33:58.194+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49678) UID: 0 2022-03-15T08:33:58.197 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:33:58.194+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49678) UID: 0 2022-03-15T08:33:58.197 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:33:58.194+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49678) UID: 0 2022-03-15T08:36:11.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:36:11.448 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:36:42.577 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:36:42.587 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:37:12.717 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:37:12.723 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:37:12.856 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:37:12.855+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49769) UID: 0 2022-03-15T08:37:12.857 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:37:12.855+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49769) UID: 0 2022-03-15T08:37:12.857 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:37:12.855+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49769) UID: 0 2022-03-15T08:39:26.490 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:39:26.496 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:39:56.651 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:39:56.657 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:40:26.816 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:40:26.822 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:40:57.788 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:40:57.794 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:41:27.937 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:41:27.943 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:41:58.077 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:41:58.083 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:42:28.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:42:28.222 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:42:58.356 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:42:58.364 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:42:58.495 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:42:58.494+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49993) UID: 0 2022-03-15T08:42:58.496 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:42:58.494+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49993) UID: 0 2022-03-15T08:42:58.497 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:42:58.494+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 49993) UID: 0 2022-03-15T08:45:17.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:45:17.592 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:45:47.747 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:45:47.753 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:46:19.388 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:46:19.395 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:46:49.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:46:49.545 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:47:19.676 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:47:19.684 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:47:49.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:47:49.831 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:48:19.971 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:48:19.977 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:48:20.365 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:48:20.362+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50191) UID: 0 2022-03-15T08:48:20.365 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:48:20.363+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50191) UID: 0 2022-03-15T08:48:20.366 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:48:20.363+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50191) UID: 0 2022-03-15T08:50:30.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:50:30.758 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:51:00.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:51:00.929 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:51:31.060 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:51:31.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:52:02.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:52:02.456 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:52:32.607 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:52:32.613 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:53:02.739 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:53:02.744 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:53:34.120 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:53:34.127 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:54:04.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:54:04.278 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:54:04.409 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:54:04.406+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50408) UID: 0 2022-03-15T08:54:04.409 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:54:04.406+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50408) UID: 0 2022-03-15T08:54:04.410 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:54:04.407+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50408) UID: 0 2022-03-15T08:56:22.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:56:22.696 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:56:22.741 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T08:56:22.740+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53484) UID: 0 2022-03-15T08:56:22.742 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T08:56:22.740+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53484) UID: 0 2022-03-15T08:56:22.743 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T08:56:22.740+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53484) UID: 0 2022-03-15T08:57:57.718 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:57:57.724 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:58:27.859 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:58:27.866 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:58:58.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:58:58.014 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:59:28.140 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:59:28.145 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T08:59:28.315 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T08:59:28.313+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50565) UID: 0 2022-03-15T08:59:28.316 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T08:59:28.314+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50565) UID: 0 2022-03-15T08:59:28.317 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T08:59:28.314+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50565) UID: 0 2022-03-15T09:01:38.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:01:38.851 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:01:39.007 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:01:39.006+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50620) UID: 0 2022-03-15T09:01:39.008 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:01:39.006+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50620) UID: 0 2022-03-15T09:01:39.008 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:01:39.006+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50620) UID: 0 2022-03-15T09:03:46.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:03:46.201 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:04:16.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:04:16.354 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:04:46.489 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:04:46.495 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:05:17.821 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:05:17.828 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:05:17.960 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:05:17.958+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50740) UID: 0 2022-03-15T09:05:17.961 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:05:17.958+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50740) UID: 0 2022-03-15T09:05:17.961 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:05:17.958+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50740) UID: 0 2022-03-15T09:07:36.366 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:07:36.374 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:08:06.529 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:08:06.535 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:08:36.669 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:08:36.675 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:09:07.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:09:07.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:09:38.187 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:09:38.194 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:10:08.313 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:10:08.319 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:10:39.570 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:10:39.575 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:10:39.923 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:10:39.921+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50936) UID: 0 2022-03-15T09:10:39.924 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:10:39.921+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50936) UID: 0 2022-03-15T09:10:39.925 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:10:39.921+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 50936) UID: 0 2022-03-15T09:12:50.383 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:12:50.390 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:13:20.579 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:13:20.585 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:13:51.693 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:13:51.699 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:14:21.838 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:14:21.846 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:14:51.980 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:14:51.988 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:15:22.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:15:22.139 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:15:58.035 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:15:58.053 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:15:58.185 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:15:58.183+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51126) UID: 0 2022-03-15T09:15:58.186 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:15:58.183+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51126) UID: 0 2022-03-15T09:15:58.187 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:15:58.183+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51126) UID: 0 2022-03-15T09:18:08.662 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:18:08.668 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:18:38.992 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:18:38.998 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:19:10.132 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:19:10.138 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:19:40.269 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:19:40.275 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:20:10.409 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:20:10.416 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:20:40.566 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:20:40.571 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:21:11.862 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:21:11.868 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:21:42.093 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:21:42.099 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:21:42.230 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:21:42.234+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51350) UID: 0 2022-03-15T09:21:42.231 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:21:42.234+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51350) UID: 0 2022-03-15T09:21:42.232 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:21:42.234+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51350) UID: 0 2022-03-15T09:24:00.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:24:00.201 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:24:30.390 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:24:30.395 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:25:01.437 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:25:01.443 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:25:31.576 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:25:31.583 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:26:02.625 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:26:02.632 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:26:32.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:26:32.770 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:27:02.903 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:27:02.909 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:27:02.945 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T09:27:02.954+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54560) UID: 0 2022-03-15T09:27:02.946 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T09:27:02.954+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54560) UID: 0 2022-03-15T09:27:02.947 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T09:27:02.954+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54560) UID: 0 2022-03-15T09:27:03.298 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:27:03.306+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51541) UID: 0 2022-03-15T09:27:03.299 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:27:03.306+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51541) UID: 0 2022-03-15T09:27:03.299 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:27:03.306+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51541) UID: 0 2022-03-15T09:29:14.064 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:29:14.071 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:29:14.225 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:29:14.235+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51582) UID: 0 2022-03-15T09:29:14.226 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:29:14.236+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51582) UID: 0 2022-03-15T09:29:14.226 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:29:14.236+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51582) UID: 0 2022-03-15T09:31:21.092 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:31:21.098 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:31:51.278 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:31:51.283 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:32:23.908 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:32:23.915 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:32:54.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:32:54.054 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:32:54.186 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:32:54.198+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51706) UID: 0 2022-03-15T09:32:54.187 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:32:54.198+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51706) UID: 0 2022-03-15T09:32:54.188 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:32:54.198+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51706) UID: 0 2022-03-15T09:35:13.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:35:13.102 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:35:43.340 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:35:43.347 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:36:13.488 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:36:13.494 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:36:44.736 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:36:44.743 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:37:14.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:37:14.922 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:37:45.057 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:37:45.085 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:38:15.753 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:38:15.761 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:38:16.047 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:38:16.060+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51897) UID: 0 2022-03-15T09:38:16.048 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:38:16.060+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51897) UID: 0 2022-03-15T09:38:16.048 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:38:16.060+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 51897) UID: 0 2022-03-15T09:40:26.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:40:26.972 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:40:57.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:40:57.150 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:41:28.250 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:41:28.256 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:41:58.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:41:58.403 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:42:28.536 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:42:28.542 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:43:00.003 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:43:00.010 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:43:30.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:43:30.320 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:44:00.653 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:44:00.659 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:44:00.754 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:44:00.770+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52122) UID: 0 2022-03-15T09:44:00.755 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:44:00.770+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52122) UID: 0 2022-03-15T09:44:00.909 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:44:00.770+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52122) UID: 0 2022-03-15T09:46:18.976 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:46:18.982 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:46:50.038 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:46:50.045 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:47:20.211 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:47:20.218 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:47:50.349 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:47:50.357 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:48:20.489 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:48:20.496 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:48:50.629 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:48:50.635 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:49:23.579 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:49:23.585 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:49:23.713 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:49:23.731+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52321) UID: 0 2022-03-15T09:49:23.714 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:49:23.731+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52321) UID: 0 2022-03-15T09:49:23.714 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:49:23.731+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52321) UID: 0 2022-03-15T09:51:34.325 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:51:34.331 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:52:04.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:52:04.508 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:52:34.633 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:52:34.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:53:05.181 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:53:05.187 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:53:35.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:53:35.327 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:54:05.459 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:54:05.464 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:54:36.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:54:36.740 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:55:07.040 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:55:07.047 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:55:07.180 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:55:07.199+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52538) UID: 0 2022-03-15T09:55:07.181 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:55:07.199+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52538) UID: 0 2022-03-15T09:55:07.181 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:55:07.199+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52538) UID: 0 2022-03-15T09:57:24.158 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:57:24.164 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:57:24.344 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T09:57:24.365+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52578) UID: 0 2022-03-15T09:57:24.345 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T09:57:24.365+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52578) UID: 0 2022-03-15T09:57:24.345 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T09:57:24.365+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52578) UID: 0 2022-03-15T09:59:44.697 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:59:44.704 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T09:59:44.740 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T09:59:44.761+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55789) UID: 0 2022-03-15T09:59:44.741 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T09:59:44.761+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55789) UID: 0 2022-03-15T09:59:44.741 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T09:59:44.761+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55789) UID: 0 2022-03-15T10:01:23.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:01:23.849 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:01:23.984 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:01:24.006+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52841) UID: 0 2022-03-15T10:01:23.985 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:01:24.006+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52841) UID: 0 2022-03-15T10:01:24.033 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:01:24.006+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 52841) UID: 0 2022-03-15T10:03:52.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:03:52.186 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:04:22.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:04:22.354 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:04:52.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:04:52.538 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:05:22.670 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:05:22.677 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:05:55.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:05:55.535 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:06:25.675 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:06:25.681 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:06:55.815 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:06:55.820 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:06:55.951 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:06:55.973+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53040) UID: 0 2022-03-15T10:06:55.952 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:06:55.973+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53040) UID: 0 2022-03-15T10:06:55.952 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:06:55.973+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53040) UID: 0 2022-03-15T10:09:09.518 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:09:09.525 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:09:39.688 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:09:39.694 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:10:10.904 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:10:10.910 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:10:41.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:10:41.324 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:11:11.457 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:11:11.462 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:11:41.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:11:41.622 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:12:13.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:12:13.831 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:12:13.961 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:12:13.984+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53236) UID: 0 2022-03-15T10:12:13.961 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:12:13.984+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53236) UID: 0 2022-03-15T10:12:13.962 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:12:13.984+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53236) UID: 0 2022-03-15T10:14:24.700 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:14:24.707 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:14:54.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:14:54.892 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:15:26.076 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:15:26.083 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:15:56.354 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:15:56.361 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:16:26.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:16:26.505 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:16:58.165 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:16:58.172 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:17:28.309 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:17:28.315 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:17:58.456 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:17:58.462 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:17:58.598 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:17:58.623+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53456) UID: 0 2022-03-15T10:17:58.599 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:17:58.623+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53456) UID: 0 2022-03-15T10:17:58.600 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:17:58.623+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53456) UID: 0 2022-03-15T10:20:16.862 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:20:16.869 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:20:47.024 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:20:47.032 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:21:17.165 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:21:17.170 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:21:48.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:21:48.369 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:22:18.643 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:22:18.650 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:22:48.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:22:48.787 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:23:20.137 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:23:20.144 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:23:20.277 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:23:20.303+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53652) UID: 0 2022-03-15T10:23:20.278 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:23:20.303+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53652) UID: 0 2022-03-15T10:23:20.278 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:23:20.303+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53652) UID: 0 2022-03-15T10:25:34.368 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:25:34.374 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:25:34.549 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:25:34.577+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53700) UID: 0 2022-03-15T10:25:34.550 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:25:34.577+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53700) UID: 0 2022-03-15T10:25:34.550 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:25:34.577+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53700) UID: 0 2022-03-15T10:27:52.208 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:27:52.215 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:28:22.354 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:28:22.360 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:28:52.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:28:52.689 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:28:52.818 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:28:52.836+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53791) UID: 0 2022-03-15T10:28:52.818 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:28:52.836+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53791) UID: 0 2022-03-15T10:28:52.819 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:28:52.836+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53791) UID: 0 2022-03-15T10:31:05.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:31:05.942 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:31:05.987 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T10:31:06.000+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56808) UID: 0 2022-03-15T10:31:05.988 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T10:31:06.000+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56808) UID: 0 2022-03-15T10:31:05.988 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T10:31:06.000+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56808) UID: 0 2022-03-15T10:32:42.687 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:32:42.692 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:33:12.890 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:33:12.896 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:33:43.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:33:43.045 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:34:13.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:34:13.185 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:34:13.320 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:34:13.328+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53945) UID: 0 2022-03-15T10:34:13.321 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:34:13.328+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53945) UID: 0 2022-03-15T10:34:13.322 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:34:13.328+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 53945) UID: 0 2022-03-15T10:36:23.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:36:23.690 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:36:53.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:36:53.851 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:37:24.151 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:37:24.157 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:37:54.298 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:37:54.357 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:38:24.497 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:38:24.503 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:38:54.644 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:38:54.651 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:39:24.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:39:24.798 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:39:54.922 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:39:54.928 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:39:55.166 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:39:55.167+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54165) UID: 0 2022-03-15T10:39:55.166 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:39:55.167+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54165) UID: 0 2022-03-15T10:39:55.167 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:39:55.167+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54165) UID: 0 2022-03-15T10:42:13.934 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:42:13.940 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:42:44.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:42:44.894 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:43:15.027 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:43:15.033 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:43:45.174 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:43:45.181 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:44:15.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:44:15.321 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:44:45.454 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:44:45.461 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:45:16.785 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:45:16.791 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:45:16.924 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:45:16.922+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54359) UID: 0 2022-03-15T10:45:16.925 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:45:16.922+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54359) UID: 0 2022-03-15T10:45:16.926 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:45:16.922+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54359) UID: 0 2022-03-15T10:47:28.087 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:47:28.093 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:47:58.273 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:47:58.280 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:48:28.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:48:28.421 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:48:37.322 INFO:tasks.ceph.mds.a.smithi151.stderr:tcmalloc: large alloc 6710886400 bytes == 0x55b7319a8000 @ 0x7f18ea0e9760 0x7f18ea10ac64 0x55b59d34e3fd 0x55b59d349806 0x55b59d1df039 0x55b59d1d2b78 0x55b59d0388ca 0x55b59d0834fb 0x55b59d12c5ec 0x55b59d2fbf43 0x55b59d31dfd7 0x55b59d1c81f6 0x55b59d1cd5fa 0x55b59d1d6dda 0x55b59d1dae04 0x55b59cfd91a4 0x55b59cfdbddb 0x55b59cfdc3fc 0x55b59cfcb2f8 0x7f18e97c3dca 0x7f18e987b0f1 0x7f18e851217f 0x7f18e6f66d83 2022-03-15T10:48:58.552 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:48:58.559 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:49:28.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:49:28.823 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:49:58.956 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:49:58.962 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:50:30.388 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:50:30.396 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:51:00.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:51:00.549 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:51:00.682 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:51:00.676+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54584) UID: 0 2022-03-15T10:51:00.683 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:51:00.676+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54584) UID: 0 2022-03-15T10:51:00.683 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:51:00.676+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54584) UID: 0 2022-03-15T10:53:16.853 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:53:16.859 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:53:17.045 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:53:17.037+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54624) UID: 0 2022-03-15T10:53:17.046 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:53:17.038+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54624) UID: 0 2022-03-15T10:53:17.046 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:53:17.038+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54624) UID: 0 2022-03-15T10:55:37.445 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:55:37.452 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:56:07.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:56:07.596 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:56:38.953 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:56:38.959 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:56:39.086 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T10:56:39.078+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54723) UID: 0 2022-03-15T10:56:39.086 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T10:56:39.078+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54723) UID: 0 2022-03-15T10:56:39.087 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T10:56:39.078+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54723) UID: 0 2022-03-15T10:58:54.606 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:58:54.613 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:59:24.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:59:24.781 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:59:54.930 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T10:59:54.936 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:00:25.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:00:25.075 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:00:55.285 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:00:55.291 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:01:25.505 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:01:25.511 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:01:56.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:01:56.919 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:01:56.956 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T11:01:56.948+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 57886) UID: 0 2022-03-15T11:01:56.957 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T11:01:56.948+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 57886) UID: 0 2022-03-15T11:01:56.957 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T11:01:56.948+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 57886) UID: 0 2022-03-15T11:01:57.052 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:01:57.045+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54929) UID: 0 2022-03-15T11:01:57.053 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:01:57.045+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54929) UID: 0 2022-03-15T11:01:57.053 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:01:57.045+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 54929) UID: 0 2022-03-15T11:04:08.027 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:04:08.033 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:04:38.197 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:04:38.203 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:05:08.425 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:05:08.437 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:05:38.576 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:05:38.582 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:06:08.715 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:06:08.720 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:06:38.857 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:06:38.863 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:07:10.117 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:07:10.123 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:07:40.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:07:40.446 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:07:40.577 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:07:40.571+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55148) UID: 0 2022-03-15T11:07:40.578 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:07:40.571+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55148) UID: 0 2022-03-15T11:07:40.578 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:07:40.571+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55148) UID: 0 2022-03-15T11:09:59.991 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:09:59.998 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:10:30.158 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:10:30.165 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:11:00.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:11:00.380 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:11:31.571 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:11:31.577 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:12:01.718 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:12:01.724 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:12:31.993 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:12:32.000 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:13:02.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:13:02.136 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:13:02.395 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:13:02.390+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55342) UID: 0 2022-03-15T11:13:02.396 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:13:02.390+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55342) UID: 0 2022-03-15T11:13:02.396 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:13:02.390+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55342) UID: 0 2022-03-15T11:15:13.372 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:15:13.452 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:15:43.617 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:15:43.624 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:16:13.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:16:13.770 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:16:43.912 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:16:43.918 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:17:14.066 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:17:14.073 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:17:44.215 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:17:44.221 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:18:14.353 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:18:14.360 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:18:44.493 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:18:44.499 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:18:44.630 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:18:44.625+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55562) UID: 0 2022-03-15T11:18:44.631 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:18:44.625+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55562) UID: 0 2022-03-15T11:18:44.632 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:18:44.625+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55562) UID: 0 2022-03-15T11:21:05.618 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:21:05.625 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:21:05.795 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:21:05.788+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55607) UID: 0 2022-03-15T11:21:05.795 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:21:05.789+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55607) UID: 0 2022-03-15T11:21:05.796 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:21:05.789+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55607) UID: 0 2022-03-15T11:23:28.791 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:23:28.828 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:23:58.968 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:23:58.974 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:24:29.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:24:29.116 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:24:29.251 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:24:29.245+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55697) UID: 0 2022-03-15T11:24:29.252 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:24:29.245+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55697) UID: 0 2022-03-15T11:24:29.252 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:24:29.245+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55697) UID: 0 2022-03-15T11:26:45.955 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:26:45.962 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:27:16.124 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:27:16.129 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:27:46.956 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:27:46.964 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:28:17.155 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:28:17.162 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:28:47.300 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:28:47.307 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:29:17.448 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:29:17.455 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:29:47.595 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:29:47.602 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:29:47.737 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:29:47.730+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55896) UID: 0 2022-03-15T11:29:47.738 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:29:47.730+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55896) UID: 0 2022-03-15T11:29:47.739 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:29:47.730+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 55896) UID: 0 2022-03-15T11:31:57.523 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:31:57.531 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:32:27.695 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:32:27.705 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:32:27.742 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T11:32:27.736+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 59094) UID: 0 2022-03-15T11:32:27.743 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T11:32:27.736+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 59094) UID: 0 2022-03-15T11:32:27.744 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T11:32:27.736+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 59094) UID: 0 2022-03-15T11:34:03.398 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:34:03.406 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:34:33.549 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:34:33.554 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:35:03.688 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:35:03.694 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:35:03.831 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:35:03.824+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56050) UID: 0 2022-03-15T11:35:03.832 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:35:03.824+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56050) UID: 0 2022-03-15T11:35:03.833 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:35:03.825+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56050) UID: 0 2022-03-15T11:37:13.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:37:13.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:37:44.059 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:37:44.064 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:38:15.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:38:15.388 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:38:45.563 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:38:45.569 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:39:15.701 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:39:15.707 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:39:45.915 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:39:45.920 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:40:17.262 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:40:17.269 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:40:47.477 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:40:47.483 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:40:47.621 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:40:47.616+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56292) UID: 0 2022-03-15T11:40:47.621 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:40:47.616+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56292) UID: 0 2022-03-15T11:40:47.622 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:40:47.616+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56292) UID: 0 2022-03-15T11:43:05.154 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:43:05.162 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:43:35.340 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:43:35.346 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:44:06.495 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:44:06.502 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:44:36.825 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:44:36.830 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:45:06.965 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:45:06.971 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:45:38.246 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:45:38.254 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:46:09.517 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:46:09.526 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:46:09.660 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:46:09.656+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56483) UID: 0 2022-03-15T11:46:09.661 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:46:09.656+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56483) UID: 0 2022-03-15T11:46:09.661 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:46:09.656+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56483) UID: 0 2022-03-15T11:48:21.971 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:48:21.989 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:48:22.140 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:48:22.138+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56524) UID: 0 2022-03-15T11:48:22.141 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:48:22.138+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56524) UID: 0 2022-03-15T11:48:22.141 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:48:22.138+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56524) UID: 0 2022-03-15T11:50:33.648 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:50:33.657 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:51:03.799 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:51:03.804 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:51:34.222 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:51:34.228 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:51:34.365 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:51:34.361+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56626) UID: 0 2022-03-15T11:51:34.366 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:51:34.361+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56626) UID: 0 2022-03-15T11:51:34.366 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:51:34.362+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56626) UID: 0 2022-03-15T11:53:45.483 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:53:45.493 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:54:15.710 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:54:15.716 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:54:45.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:54:45.854 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:55:16.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:55:16.134 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:55:46.270 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:55:46.276 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:56:16.418 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:56:16.424 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:56:47.558 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:56:47.564 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:57:17.712 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:57:17.720 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:57:17.851 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T11:57:17.847+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56838) UID: 0 2022-03-15T11:57:17.851 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T11:57:17.847+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56838) UID: 0 2022-03-15T11:57:17.852 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T11:57:17.847+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 56838) UID: 0 2022-03-15T11:59:35.149 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T11:59:35.156 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:00:05.327 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:00:05.334 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:00:35.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:00:35.594 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:01:07.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:01:07.788 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:01:38.172 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:01:38.183 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:02:08.328 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:02:08.336 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:02:38.474 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:02:38.481 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:02:38.959 INFO:tasks.ceph.mds.a.smithi151.stderr:2022-03-15T12:02:38.955+0000 7f18e251b700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 57208) UID: 0 2022-03-15T12:02:38.960 INFO:tasks.ceph.mds.c.smithi151.stderr:2022-03-15T12:02:38.955+0000 7f603f64d700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 57208) UID: 0 2022-03-15T12:02:38.960 INFO:tasks.ceph.mds.e.smithi151.stderr:2022-03-15T12:02:38.955+0000 7fce91814700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 57208) UID: 0 2022-03-15T12:04:49.691 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:04:49.699 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:04:49.744 INFO:tasks.ceph.mds.b.smithi164.stderr:2022-03-15T12:04:49.740+0000 7f925afa3700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 60194) UID: 0 2022-03-15T12:04:49.745 INFO:tasks.ceph.mds.d.smithi164.stderr:2022-03-15T12:04:49.740+0000 7f77809ad700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 60194) UID: 0 2022-03-15T12:04:49.745 INFO:tasks.ceph.mds.f.smithi164.stderr:2022-03-15T12:04:49.740+0000 7fdf8bec8700 -1 received signal: Hangup from killall ceph-mds -1 (PID: 60194) UID: 0 2022-03-15T12:06:28.269 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:06:28.276 DEBUG:teuthology.orchestra.run.smithi164:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2022-03-15T12:06:31.396 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-03-15T12:06:31.398 DEBUG:teuthology.task.console_log:Killing console logger for smithi151 2022-03-15T12:06:31.399 DEBUG:teuthology.task.console_log:Killing console logger for smithi164 2022-03-15T12:06:31.399 DEBUG:teuthology.exit:Finished running handlers